UI Testing with Starter, how to configure in CI pipeline

Hey folks, I want to enable plugin UI Testing in CI pipeline. UI testing will run on 2025.1+
I’m using the starter framework following this link: Integration Tests: UI Testing | IntelliJ Platform Plugin SDK

When it comes to CI pipeline, the IDE asks for a license at startup:
Screenshot from UI testing video:

Is there a way to disable that?
Or is there a suggestion way to configure the license in CI? Thanks!

Oh I found the method: intellij-community/tools/intellij.tools.ide.starter/src/com/intellij/ide/starter/ide/IDETestContext.kt at b76de2a6040beb10a4782d23756b58c2ce24e157 · JetBrains/intellij-community

Hey @yuriy.artamonov Just want to confirm with you if I configure a license into CI pipeline, will it be marked as macilious/abnormal, and then be blocked. As when it running in github actions, the IP address will be changed, it many runs in a day.

Hi, please take a look at some suggestions in the UI tests blocked by login popup and “bash requesting screen access” dialog in the latest 2025.3 EAP build 253.27864.23 thread.

Thanks @robert.novotny ! I’ve checked this thread. Yes it suggests to configure license and that’s what I’m currently doing: intellij-community/tools/intellij.tools.ide.starter/src/com/intellij/ide/starter/ide/IDETestContext.kt at 429bad0bc2617285a3cc149f1e90b58fb0226abe · JetBrains/intellij-community.

I just have the concern if the license configured into CI pipelines be flagged as an anomaly or considered malicious by any security or compliance checks. If this is an unnecessary worry and there’s no risk of such action, I’ll proceed with setting the license in the CI pipelines as planned.

My personal opinion is that you can treat the license in the same way as any other secrets in the CI, e. g. API keys or credentials. The same security or compliance checks should apply.

1 Like

Thanks @robert.novotny !