Skip to content

Infinite loop when using search_pubs (?) #566

Description

@InAnYan

Describe the bug

I have used scholarly for quite a time. Everything was okay. But at one moment, when I use

scholarly.search_pubs('python')

It doesn't end.

These log lines repeat infinitely:

DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request

To Reproduce

Nothing special:

scholarly.search_pubs('python')

Expected behavior

Either a publication (iterator for publications), or an error.

Screenshots

None.

Desktop (please complete the following information):

  • Proxy service: None
  • python version: 3.12
  • OS: Arch Linux
  • Version 1.7.11

Do you plan on contributing?

No

Additional context

Full logs:

Details ```plain Python 3.13.2 (main, Feb 5 2025, 08:05:21) [GCC 14.2.1 20250128] on linux Type "help", "copyright", "credits" or "license" for more information. >>> from scholarly import scholarly >>> import logging >>> logging.basicConfig(level=logging.DEBUG) >>> it = scholarly.search_pubs("python") INFO:scholarly:Getting https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33 DEBUG:httpcore.connection:connect_tcp.started host='scholar.google.com' port=443 local_address=None timeout=5 socket_options=None DEBUG:httpcore.connection:connect_tcp.complete return_value= DEBUG:httpcore.connection:start_tls.started ssl_context= server_hostname='scholar.google.com' timeout=5 DEBUG:httpcore.connection:start_tls.complete return_value= DEBUG:httpcore.http11:send_request_headers.started request= DEBUG:httpcore.http11:send_request_headers.complete DEBUG:httpcore.http11:send_request_body.started request= DEBUG:httpcore.http11:send_request_body.complete DEBUG:httpcore.http11:receive_response_headers.started request= DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 302, b'Found', [(b'Location', b'https://www.google.com/sorry/index?continue=https://scholar.google.com/scholar%3Fhl%3Den%26q%3Dpython%26as_vis%3D0%26as_sdt%3D0,33&hl=en&q=EgRTqtIaGPfnkL8GIiwgUSqU8W8HRSo5J5H4FbXtT7lg5Egl49APmrPv4C4WNIFmHZLkHvIkX5fkKTICclJaAUM'), (b'Date', b'Wed, 26 Mar 2025 17:05:59 GMT'), (b'Pragma', b'no-cache'), (b'Expires', b'Fri, 01 Jan 1990 00:00:00 GMT'), (b'Cache-Control', b'no-store, no-cache, must-revalidate'), (b'Content-Type', b'text/html; charset=UTF-8'), (b'Server', b'HTTP server (unknown)'), (b'Content-Length', b'431'), (b'X-XSS-Protection', b'0'), (b'Alt-Svc', b'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000')]) INFO:httpx:HTTP Request: GET https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33 "HTTP/1.1 302 Found" DEBUG:httpcore.http11:receive_response_body.started request= DEBUG:httpcore.http11:receive_response_body.complete DEBUG:httpcore.http11:response_closed.started DEBUG:httpcore.http11:response_closed.complete DEBUG:httpcore.connection:connect_tcp.started host='www.google.com' port=443 local_address=None timeout=5 socket_options=None DEBUG:httpcore.connection:connect_tcp.complete return_value= DEBUG:httpcore.connection:start_tls.started ssl_context= server_hostname='www.google.com' timeout=5 DEBUG:httpcore.connection:start_tls.complete return_value= DEBUG:httpcore.http11:send_request_headers.started request= DEBUG:httpcore.http11:send_request_headers.complete DEBUG:httpcore.http11:send_request_body.started request= DEBUG:httpcore.http11:send_request_body.complete DEBUG:httpcore.http11:receive_response_headers.started request= DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 429, b'Too Many Requests', [(b'Date', b'Wed, 26 Mar 2025 17:06:00 GMT'), (b'Pragma', b'no-cache'), (b'Expires', b'Fri, 01 Jan 1990 00:00:00 GMT'), (b'Cache-Control', b'no-store, no-cache, must-revalidate'), (b'Content-Type', b'text/html'), (b'Server', b'HTTP server (unknown)'), (b'Content-Length', b'3277'), (b'X-XSS-Protection', b'0'), (b'Alt-Svc', b'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000')]) INFO:httpx:HTTP Request: GET https://www.google.com/sorry/index?continue=https://scholar.google.com/scholar%3Fhl%3Den%26q%3Dpython%26as_vis%3D0%26as_sdt%3D0,33&hl=en&q=EgRTqtIaGPfnkL8GIiwgUSqU8W8HRSo5J5H4FbXtT7lg5Egl49APmrPv4C4WNIFmHZLkHvIkX5fkKTICclJaAUM "HTTP/1.1 429 Too Many Requests" DEBUG:httpcore.http11:receive_response_body.started request= DEBUG:httpcore.http11:receive_response_body.complete DEBUG:httpcore.http11:response_closed.started DEBUG:httpcore.http11:response_closed.complete INFO:scholarly:Got a captcha request. DEBUG:selenium.webdriver.common.selenium_manager:Selenium Manager binary found at: /mnt/data/projects/ai-paper-gen/.venv/lib/python3.13/site-packages/selenium/webdriver/common/linux/selenium-manager DEBUG:selenium.webdriver.common.selenium_manager:Executing process: /mnt/data/projects/ai-paper-gen/.venv/lib/python3.13/site-packages/selenium/webdriver/common/linux/selenium-manager --browser firefox --debug --language-binding python --output json DEBUG:selenium.webdriver.common.selenium_manager:geckodriver not found in PATH DEBUG:selenium.webdriver.common.selenium_manager:firefox detected at /usr/bin/firefox DEBUG:selenium.webdriver.common.selenium_manager:Running command: /usr/bin/firefox -v DEBUG:selenium.webdriver.common.selenium_manager:Output: "Mozilla Firefox 136.0.1" DEBUG:selenium.webdriver.common.selenium_manager:Detected browser: firefox 136.0.1 DEBUG:selenium.webdriver.common.selenium_manager:Required driver: geckodriver 0.36.0 DEBUG:selenium.webdriver.common.selenium_manager:geckodriver 0.36.0 already in the cache DEBUG:selenium.webdriver.common.selenium_manager:Driver path: /home/ruslan/.cache/selenium/geckodriver/linux64/0.36.0/geckodriver DEBUG:selenium.webdriver.common.selenium_manager:Browser path: /usr/bin/firefox DEBUG:selenium.webdriver.common.service:Started executable: `/home/ruslan/.cache/selenium/geckodriver/linux64/0.36.0/geckodriver` in a child process with pid: 7751 using 0 to output -3 DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session {'capabilities': {'firstMatch': [{}], 'alwaysMatch': {'browserName': 'firefox', 'acceptInsecureCerts': True, 'moz:debuggerAddress': True, 'pageLoadStrategy': , 'browserVersion': None, 'moz:firefoxOptions': {'binary': '/usr/bin/firefox', 'prefs': {'remote.active-protocols': 3}, 'args': ['--headless']}}}} DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:53431 DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":{"sessionId":"e2b872d2-c58b-44f3-96d0-949c7541fca4","capabilities":{"acceptInsecureCerts":true,"browserName":"firefox","browserVersion":"136.0.1","moz:accessibilityChecks":false,"moz:buildID":"20250311232648","moz:debuggerAddress":"127.0.0.1:48675","moz:geckodriverVersion":"0.36.0","moz:headless":true,"moz:platformVersion":"6.13.7-arch1-1","moz:processID":7758,"moz:profile":"/tmp/rust_mozprofile2IPIjJ","moz:shutdownTimeout":60000,"moz:webdriverClick":true,"moz:windowless":false,"pageLoadStrategy":"normal","platformName":"linux","proxy":{},"setWindowRect":true,"strictFileInteractability":false,"timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"unhandledPromptBehavior":"dismiss and notify","userAgent":"Mozilla/5.0 (X11; Linux x86_64; rv:136.0) Gecko/20100101 Firefox/136.0"}}} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '802', 'date': 'Wed, 26 Mar 2025 17:06:00 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {'url': 'https://scholar.google.com'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '14', 'date': 'Wed, 26 Mar 2025 17:06:00 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '39', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '39', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {'url': 'https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '14', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request xDEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {} DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'} DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0 DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'}) DEBUG:selenium.webdriver.remote.remote_connection:Finished Request ```

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions