Skip to content

test(browser): make signup email test fail-fast and accept login flow #801

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
leo-notte wants to merge 5 commits into
base: main
Choose a base branch
from
Open

test(browser): make signup email test fail-fast and accept login flow #801

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
c0fec14
test(browser): tighten signup email test failure mode and prompt
leo-notte May 7, 2026
f7bb886
test(browser): cap signup email test at 90s per attempt, restore flaky
leo-notte May 7, 2026
74d7376
test(browser): raise signup email test timeout to 120s
leo-notte May 7, 2026
314faf9
test(browser): harden anti-Google guardrails in signup email prompt
leo-notte May 7, 2026
9b8dc75
test(browser): capture signup email test logs to file artifact
leo-notte May 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 10 additions & 4 deletions tests/browser/test_tools.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,15 +52,21 @@ def test_tool_execution_in_session(persona: NottePersona, action: EmailReadActio
assert len(out.data.structured.get().emails) > 0


@pytest.mark.flaky(reruns=3, reruns_delay=5)
def test_signup_email_extraction(persona: NottePersona):
with notte.Session(headless=True) as session:
agent = notte.Agent(session=session, persona=persona, max_steps=15)
resp = agent.run(
task=(
"Go to console.notte.cc, login with the email signup email, verify the account. "
"Stop after the account is verified, i.e as soon as your are on the 'One more second' page."
"CRITICAL: do not fill the in the onboarding form, just stop after the account is verified"
"Go to console.notte.cc and authenticate with the persona's email. "
"If the account does not exist yet, sign up; if it already exists, log in. Either path is fine. "
"CRITICAL: never use Google sign-in, GitHub sign-in, or any other social/SSO option — "
"always pick the plain email flow (email + password, or email magic link). "
"When a verification or magic-link email is required, check the persona's inbox and open "
"the link from that email to complete authentication. "
"Success = you are authenticated and have landed inside the console (any logged-in page is "
"acceptable, e.g. the 'One more second' interstitial, the personal/agent console, or the "
"dashboard). Stop as soon as you reach any logged-in page. "
"CRITICAL: do not fill in any onboarding form — stop immediately once authenticated."
),
url="https://console.notte.cc",
)
Expand Down
Loading