PROJECT (loknow_spiders_prod)
SPIDER (StrathmoremotorsSpider)

2026-05-29 21:50:24 [scrapy.utils.log] INFO: Scrapy 2.10.0 started (bot: retriever)
2026-05-29 21:50:24 [scrapy.utils.log] INFO: Versions: lxml 5.1.0.0, libxml2 2.12.3, cssselect 1.2.0, parsel 1.9.0, w3lib 2.0.0, Twisted 22.4.0, Python 3.10.12 (main, Mar  3 2026, 11:56:32) [GCC 11.4.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.5, Platform Linux-6.8.0-1030-aws-x86_64-with-glibc2.35
2026-05-29 21:50:24 [scrapy.addons] INFO: Enabled addons:
[]
2026-05-29 21:50:24 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
 'AUTOTHROTTLE_MAX_DELAY': 120,
 'BOT_NAME': 'retriever',
 'CONCURRENT_REQUESTS_PER_DOMAIN': 3,
 'DOWNLOAD_DELAY': 20,
 'HTTPCACHE_EXPIRATION_SECS': 86400,
 'IMAGES_STORE_S3_ACL': 'public-read',
 'LOG_FILE': '/home/scrapyd/logs/loknow_spiders_prod/StrathmoremotorsSpider/631701885ba811f1bdc0c3bbae71ecef.log',
 'LOG_FORMATTER': 'loknow_spiders.logging.PoliteLogFormatter',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'loknow_spiders.spiders',
 'RETRY_TIMES': 4,
 'ROBOTSTXT_OBEY': True,
 'SPIDER_MODULES': ['loknow_spiders.spiders'],
 'TELNETCONSOLE_ENABLED': False,
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': 'AdRetriever (https://adretriever.com)'}
2026-05-29 21:50:24 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/utils/request.py:248: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.

It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.

See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
  return cls(crawler)

2026-05-29 21:50:24 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2026-05-29 21:50:24 [StrathmoremotorsSpider] INFO: Current Spider Environment set to: prod
2026-05-29 21:50:24 [StrathmoremotorsSpider] INFO: Retrieving AWS secret: spider_prod_secrets
2026-05-29 21:50:24 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 21:50:25 [StrathmoremotorsSpider] INFO: In base spider ml_kwargs is None and scrape_type is inventory
2026-05-29 21:50:25 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'loknow_spiders.middlewares.ThrottlingRetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-29 21:50:25 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'loknow_spiders.middlewares.RetrieverSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-05-29 21:50:26 [scrapy.middleware] INFO: Enabled item pipelines:
['loknow_spiders.pipelines.HTMLDetailsDecruftPipeline',
 'loknow_spiders.pipelines.GPTVehiclePipeline',
 'loknow_spiders.pipelines.PostProcessGPTVehiclePipeline',
 'loknow_spiders.pipelines.StrathmoremotorsPipeline',
 'loknow_spiders.pipelines.RetrieverPipeline']
2026-05-29 21:50:26 [scrapy.core.engine] INFO: Spider opened
2026-05-29 21:50:26 [StrathmoremotorsSpider] INFO: RetrieverAPI is making requests to https://api.adretriever.com with headers {'Authorization': 'Token 96dfb640234f1d676d6fa726f8eae6e7aab44cda'}
2026-05-29 21:50:26 [loknow_spiders] INFO: Scrape e3d66172 has been opened.
2026-05-29 21:50:26 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 21:50:26 [scrapy-playwright] INFO: Starting download handler
2026-05-29 21:50:26 [scrapy-playwright] INFO: Starting download handler
2026-05-29 21:51:01 [scrapy-playwright] INFO: Launching browser chromium
2026-05-29 21:51:01 [scrapy-playwright] INFO: Browser chromium launched
2026-05-29 21:51:26 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 21:51:27 [loknow_spiders] INFO: Clicking next page element...
2026-05-29 21:51:54 [loknow_spiders] INFO: Clicking next page element...
2026-05-29 21:52:19 [loknow_spiders] INFO: Clicking next page element...
2026-05-29 21:52:26 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 21:52:35 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:52:40 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:7ea95c6e3bad4ef8e47facecb4b4f77e
2026-05-29 21:52:41 [loknow_spiders] INFO: Timeout querying next page element (could be the last page)
2026-05-29 21:52:41 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:52:45 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 21:52:45 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-silverado-3500hd-lt-KdSTjSGMTASU8Hze10decgvdp
2026-05-29 21:52:45 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:52:46 [loknow_spiders] INFO: Created: 1 items out of 1
2026-05-29 21:52:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-2760' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:52:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-4686' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:52:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-4300' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:52:52 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-chevrolet-colorado-4wd-z71-kzikchFZSsqzEckbJNTujAvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-chevrolet-colorado-4wd-z71-kzikchFZSsqzEckbJNTujAvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 21:53:14 [loknow_spiders] INFO: Timeout querying next page element (could be the last page)
2026-05-29 21:53:14 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:53:22 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:53:23 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-1052' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:53:23 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-6193' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:53:23 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:3e525e34dfe4ed3650acc5df81997e55
2026-05-29 21:53:26 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 1 pages/min), scraped 1 items (at 1 items/min)
2026-05-29 21:53:27 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 21:53:27 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-4B2eR8XASL623sGouczLpgvdp
2026-05-29 21:53:46 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:53:47 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-7664' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:53:47 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-7384' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:53:47 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:cbb0fec65ea4f49303cc4b2a09a2c0e3
2026-05-29 21:53:50 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 21:53:50 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-N71FNGC4QGqQvZAe0rzp6gvdp
2026-05-29 21:53:50 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:53:51 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 21:54:01 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-8957' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:54:25 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:54:27 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 3 items (at 2 items/min)
2026-05-29 21:54:27 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:59d6a95751b7da5cb547c6c690081e12
2026-05-29 21:54:30 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 21:54:30 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-canyon-denali-QWwNVl5YRnOuG6ufaDfa4Qvdp
2026-05-29 21:55:00 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-10371' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:55:07 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:55:11 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:5e067b9fd7b5b4c850383835b6f1ef2c
2026-05-29 21:55:11 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-at4-pAyc6sWsSZmQxhLjSuDGWAvdp
2026-05-29 21:55:11 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:55:11 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 21:55:26 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 2 pages/min), scraped 5 items (at 2 items/min)
2026-05-29 21:55:29 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-12253' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:55:29 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-11953' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:55:34 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:55:37 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:8bc8053ec89915273175c0e14b8aa774
2026-05-29 21:55:37 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-equinox-awd-activ-GdiAZrneQY24ExwijIQ9AAvdp
2026-05-29 21:55:43 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-13500' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:55:59 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:56:02 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:fa4c397cbe6d9ed9906c8b2ab8f66c6a
2026-05-29 21:56:02 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-f1roTV0RQS6Ah6Qx0sEz2gvdp
2026-05-29 21:56:05 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-15041' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:56:05 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-15363' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:56:26 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 1 pages/min), scraped 7 items (at 2 items/min)
2026-05-29 21:56:50 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:56:55 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:8c1ca8b45e48107353324e00d1f3b3ae
2026-05-29 21:56:55 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-traverse-z71-0BerGjOcTeejXecQ0sitbAvdp
2026-05-29 21:56:55 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:56:56 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 21:56:57 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:56:59 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-16624' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:56:59 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:813d166d7497f58824f63ad6ac426994
2026-05-29 21:56:59 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-tahoe-high-country-hE68fwxpRW6XfDH6tJcP3gvdp
2026-05-29 21:57:25 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-18082' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:57:26 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 3 pages/min), scraped 9 items (at 2 items/min)
2026-05-29 21:57:34 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:57:37 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:9fcd7901ea3d5bf6c8057b66f445d916
2026-05-29 21:57:40 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 21:57:40 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-sG387n7RTEyl7n1BmXrFvgvdp
2026-05-29 21:57:50 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:57:51 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-19520' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:57:51 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-19801' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:57:51 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:ca81a68ce791732d5f680f71283c89b0
2026-05-29 21:57:51 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-yy53ac5EQkKtomSu48YGlQvdp
2026-05-29 21:57:54 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-21103' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:58:06 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:58:06 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:f1d62c2b69057b0578babca0cd93ad37
2026-05-29 21:58:06 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-XggnF4YUTvmbJkRoKvI2fQvdp
2026-05-29 21:58:06 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:58:07 [loknow_spiders] INFO: Created: 4 items out of 4
2026-05-29 21:58:12 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-22919' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:58:12 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-22599' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:58:26 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 3 pages/min), scraped 12 items (at 3 items/min)
2026-05-29 21:58:40 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:58:41 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:0ab4c0f992f3a72a5495dc2567ad630c
2026-05-29 21:58:41 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-enclave-sport-touring-Irjs7zEmRqaOH3vqe1RZBwvdp
2026-05-29 21:58:42 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-24257' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:59:06 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:59:09 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:0e4c0e2034e46e516a8568920bca37d6
2026-05-29 21:59:09 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-terrain-awd-at4-Cu5SZbHzST664lLrp51EEQvdp
2026-05-29 21:59:09 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 21:59:09 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 21:59:26 [scrapy.extensions.logstats] INFO: Crawled 18 pages (at 1 pages/min), scraped 14 items (at 2 items/min)
2026-05-29 21:59:49 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 21:59:50 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-25737' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 21:59:53 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:a5c982e0b1a904d33cd21a5e266fffae
2026-05-29 21:59:53 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-qGloP9w9TYuiFnGMrLO6Cgvdp
2026-05-29 22:00:20 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:00:21 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-27595' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:00:21 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-27250' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:00:26 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 2 pages/min), scraped 15 items (at 1 items/min)
2026-05-29 22:00:26 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:0137e43bcf49993381993cdbdda1d9f9
2026-05-29 22:00:32 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:00:32 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-equinox-awd-rs-Rmsf3bNRRZ6Umz0s9ScWHQvdp
2026-05-29 22:00:32 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:00:32 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:00:43 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-28894' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:01:02 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:01:05 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:64d9fd083462032c3c59de5b83468af6
2026-05-29 22:01:05 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-encore-gx-sport-touring-j3pOCK1qRYaluId4KMCyewvdp
2026-05-29 22:01:14 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:01:15 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-30343' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:01:17 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:76874e5377c63e72afbcd4da7431d0f0
2026-05-29 22:01:17 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-encore-gx-avenir-GlDGr1W5QsqXfwxhJyiVvQvdp
2026-05-29 22:01:26 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 2 pages/min), scraped 18 items (at 3 items/min)
2026-05-29 22:01:54 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-31946' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:02:11 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:02:16 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:6222206eca2ce1f903ab205b1d0ed9b5
2026-05-29 22:02:16 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2025-chevrolet-trax-lt-OWrs6gwNSdeRk56F7UKOtwvdp
2026-05-29 22:02:16 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:02:16 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:02:19 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-33483' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:02:19 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-33763' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:02:21 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-gmc-canyon-elevation-ArFkBrxqTpuckXo4HVGc0Qvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-gmc-canyon-elevation-ArFkBrxqTpuckXo4HVGc0Qvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:02:26 [scrapy.extensions.logstats] INFO: Crawled 23 pages (at 1 pages/min), scraped 19 items (at 1 items/min)
2026-05-29 22:02:46 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:02:47 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-35014' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:02:47 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:6d41fed3e2729ccd1ff4413968bc86e7
2026-05-29 22:02:52 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:02:52 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-trazUBrJRZ6FheOLxVHbkQvdp
2026-05-29 22:03:24 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:03:25 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-36294' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:03:26 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 2 pages/min), scraped 20 items (at 1 items/min)
2026-05-29 22:03:26 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:5340279e04987365c17b9d3cf2c0b51d
2026-05-29 22:03:26 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-2rs-Kky65GQLQCuqChujWLfVHQvdp
2026-05-29 22:03:26 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:03:27 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:03:53 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:03:54 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-37765' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:03:55 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:2f3a9434887d66bb4a89199ec89a9521
2026-05-29 22:03:55 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2025-buick-envision-preferred-75HyL6iPRtqczNWgqSyT5gvdp
2026-05-29 22:03:58 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-39393' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:04:26 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 2 pages/min), scraped 22 items (at 2 items/min)
2026-05-29 22:04:36 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:04:39 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:fd429a00e383d11f7ff83fc3dc1cbc6d
2026-05-29 22:04:44 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:04:44 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-encore-gx-sport-touring-TxeNgS6STdKDRjEqNVMn6gvdp
2026-05-29 22:04:44 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:04:45 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:05:07 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:05:07 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-40835' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:05:09 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:748f6b75e35a12378cf55a767dc11b25
2026-05-29 22:05:09 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-1rs-LTSjxoy2TyOiNsRZU5Zamgvdp
2026-05-29 22:05:26 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 2 pages/min), scraped 24 items (at 2 items/min)
2026-05-29 22:05:28 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:05:29 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-42447' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:05:29 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-42883' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:05:32 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:16467c4d33bf4e042d8b4a3551e45623
2026-05-29 22:05:41 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:05:41 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-canyon-at4-jVqpD8CfTCOJ59ZCgbIB8gvdp
2026-05-29 22:05:42 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-slt-kVYRij4QSTGGLWHU2feCDQvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-slt-kVYRij4QSTGGLWHU2feCDQvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:06:04 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-chevrolet-trax-lt-wib8c0dzQq6wvDYSbeo3uwvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-chevrolet-trax-lt-wib8c0dzQq6wvDYSbeo3uwvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:06:27 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-44018' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:06:27 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-45606' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:06:27 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-46779' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:06:27 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 0 pages/min), scraped 25 items (at 1 items/min)
2026-05-29 22:06:47 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:06:48 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:6e630d8d77f4af27975830843dee8b08
2026-05-29 22:06:52 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:06:52 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-activ-TYZRUGaVTUSb9Xb4fQooNQvdp
2026-05-29 22:06:52 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:06:53 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:07:00 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:07:01 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-47895' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:07:01 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-48241' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:07:02 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:d19a6c2e6adee25c4e9182c398e9f7d2
2026-05-29 22:07:02 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-2rs-0mtTox8zR3Ke2wO2DdIKZQvdp
2026-05-29 22:07:06 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-49471' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:07:26 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 3 pages/min), scraped 27 items (at 2 items/min)
2026-05-29 22:07:41 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:07:48 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:c2789219ff47036406251a95e28c90fb
2026-05-29 22:07:53 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:07:53 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-dwPszzJqQ2eMjSDWVFuhzAvdp
2026-05-29 22:07:53 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:07:54 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:08:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-51018' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:08:26 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 1 pages/min), scraped 28 items (at 1 items/min)
2026-05-29 22:08:29 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-H474Fz65TWmiB9w0RF8uOAvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-H474Fz65TWmiB9w0RF8uOAvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:08:49 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-M6HqFDqnTMWZbi72oHcXxwvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-M6HqFDqnTMWZbi72oHcXxwvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:08:53 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:08:57 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:70281739f457ef478720d2e24f945e4a
2026-05-29 22:08:57 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-activ-NlXufVdjTbWGcB1wGWn2ogvdp
2026-05-29 22:08:57 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:08:57 [loknow_spiders] INFO: Created: 1 items out of 1
2026-05-29 22:09:11 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-52526' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:09:26 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 0 pages/min), scraped 29 items (at 1 items/min)
2026-05-29 22:09:46 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:09:50 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:45ebe636bd96e77710e512272376d2ce
2026-05-29 22:09:57 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:09:57 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-acadia-elevation-JlHFUL84Q3GnQUOvps3cogvdp
2026-05-29 22:10:26 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 1 pages/min), scraped 30 items (at 1 items/min)
2026-05-29 22:10:39 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-55917' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:11:03 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-gmc-terrain-awd-at4-dRkGWAdJQRSM431RPF9Nawvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-gmc-terrain-awd-at4-dRkGWAdJQRSM431RPF9Nawvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:11:03 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:11:06 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-58951' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:11:07 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:ffa598c92e61811bfd2be8daea62d045
2026-05-29 22:11:10 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:11:10 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-acadia-elevation-fbtmPUiTQzOJ1O1tr72Phgvdp
2026-05-29 22:11:10 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:11:11 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:11:26 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 1 pages/min), scraped 31 items (at 1 items/min)
2026-05-29 22:11:27 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-57367' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:11:50 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:11:51 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:9424651b1da764583878744b98154d7b
2026-05-29 22:11:55 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:11:55 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-canyon-elevation-8p9ginZARKusxC7IUBPc1wvdp
2026-05-29 22:12:26 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 2 pages/min), scraped 32 items (at 1 items/min)
2026-05-29 22:12:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-60087' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:12:47 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:12:50 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:c99971c722fb4ad1d2847b614028649b
2026-05-29 22:12:50 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-preferred-1q8SKs2bQ6qgSrngmJY7Mwvdp
2026-05-29 22:12:50 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:12:50 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:13:09 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:13:09 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-61633' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:13:09 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-61937' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:13:11 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:c71d417436a77417e14b49c6940c6e1c
2026-05-29 22:13:16 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:13:16 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-sport-touring-CKmnMVMWQ4GGCgKF6W5PMgvdp
2026-05-29 22:13:26 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 2 pages/min), scraped 34 items (at 2 items/min)
2026-05-29 22:13:35 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-63286' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:13:35 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-63600' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:13:48 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:13:50 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:485488be41c62bc000241ef594015b6a
2026-05-29 22:13:57 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:13:57 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-canyon-elevation-1vJ9B1p9QBGmUxn2xMqiswvdp
2026-05-29 22:13:57 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:13:58 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:14:15 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:14:16 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-65057' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:14:16 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-64791' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:14:17 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:018bade5670efce0cb7cc235898aecbb
2026-05-29 22:14:21 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:14:21 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envista-preferred-z6HuWTDBSEOP7gsuyFc1egvdp
2026-05-29 22:14:26 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 2 pages/min), scraped 36 items (at 2 items/min)
2026-05-29 22:14:37 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:14:38 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-66330' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:14:41 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:ff5a57994e0e99befc92e173d2cdbb63
2026-05-29 22:14:45 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:14:45 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-activ-xPiBSxbMSUGqKD5xjRhk5Avdp
2026-05-29 22:14:58 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:14:58 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-67894' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:14:59 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:664727d2ddef7b93e7ed21b9aa7c8d16
2026-05-29 22:14:59 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-trax-2rs-fys07fVHQx6CD3dwCXcdeAvdp
2026-05-29 22:14:59 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:15:00 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:15:03 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-69379' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:15:03 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-69687' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:15:26 [scrapy.extensions.logstats] INFO: Crawled 43 pages (at 2 pages/min), scraped 38 items (at 2 items/min)
2026-05-29 22:15:39 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:15:42 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:fdb7d6474511fc2fea517c4ce94da071
2026-05-29 22:15:47 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:15:47 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-acadia-elevation-EYmKuQieTNuGjqidV8wKKwvdp
2026-05-29 22:16:05 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-70947' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:16:08 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:16:09 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:318fd3f4b3a732e169aff758b0232701
2026-05-29 22:16:09 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-D6lrHAcGTWCXu1RcregBnQvdp
2026-05-29 22:16:09 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:16:09 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:16:18 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-72584' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:16:26 [scrapy.extensions.logstats] INFO: Crawled 45 pages (at 2 pages/min), scraped 40 items (at 2 items/min)
2026-05-29 22:16:30 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:16:33 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:b2a35a43a8433124dda39f4367ecba50
2026-05-29 22:16:37 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:16:37 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-el6RdQqDSWuI1iFlD5yp7Qvdp
2026-05-29 22:16:41 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-74073' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:17:14 [StrathmoremotorsSpider] INFO: Closed Playwright page (handling failure for <GET https://strathmoremotors.com/inventory/2026-buick-envision-preferred-WEtqXEY9Said35d2dqohBQvdp> [Failure instance: Traceback: <class 'playwright._impl._errors.TimeoutError'>: Page.goto: Timeout 30000ms exceeded.
Call log:
  - navigating to "https://strathmoremotors.com/inventory/2026-buick-envision-preferred-WEtqXEY9Said35d2dqohBQvdp", waiting until "load"

/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:700:errback
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:763:_startRunCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:857:_runCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1750:gotResult
--- <exception caught here> ---
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1656:_inlineCallbacks
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/python/failure.py:514:throwExceptionIntoGenerator
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy/core/downloader/middleware.py:54:process_request
/home/scrapyd/venv/lib/python3.10/site-packages/twisted/internet/defer.py:1030:adapt
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:403:_download_request
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:432:_download_request_with_page
/home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:532:_get_response_and_download
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/async_api/_generated.py:8975:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_page.py:556:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_frame.py:146:goto
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:69:send
/home/scrapyd/venv/lib/python3.10/site-packages/playwright/_impl/_connection.py:558:wrap_api_call
])
2026-05-29 22:17:15 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:17:16 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-77973' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:17:18 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:2c9aaf934981da495ccde9a7cd74d0bc
2026-05-29 22:17:18 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-9BXdWBVkSnOVogqDQDviFgvdp
2026-05-29 22:17:18 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:17:18 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:17:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-75977' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:17:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-75620' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:17:26 [scrapy.extensions.logstats] INFO: Crawled 46 pages (at 1 pages/min), scraped 42 items (at 2 items/min)
2026-05-29 22:17:58 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:17:59 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:5b32bed7a896454247414edfeeb13e73
2026-05-29 22:17:59 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2015-chevrolet-silverado-2500hd-ltz-zGANd6gFSPicdKWKP2D7sgvdp
2026-05-29 22:18:03 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:18:04 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-79930' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:18:06 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:23132d15c1ec9069bab3c5a0ff3645d0
2026-05-29 22:18:10 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:18:10 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-avenir-yHwRMVrYQJiw3CA8sVRUPgvdp
2026-05-29 22:18:26 [scrapy.extensions.logstats] INFO: Crawled 49 pages (at 3 pages/min), scraped 44 items (at 2 items/min)
2026-05-29 22:18:30 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:18:31 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-78397' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:18:31 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-78697' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:18:32 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:f1ff1328631d90ca03e5fe4a64c80bf1
2026-05-29 22:18:36 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:18:36 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2020-chevrolet-malibu-lt-jyAhcJcbQrC7G1BmzZU2fgvdp
2026-05-29 22:18:36 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:18:36 [loknow_spiders] INFO: Created: 2 items out of 3
2026-05-29 22:18:37 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-81400' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:18:50 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:18:50 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:f98dec7aaf6c5b26ba12aa501dd6eac0
2026-05-29 22:18:56 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:18:56 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2018-ford-ecosport-s-DYoB3TtLS0On9cSX92eDPgvdp
2026-05-29 22:19:21 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-82828' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:19:22 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:19:23 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:eeb11fb63acc7751f93e96b8bec12aa9
2026-05-29 22:19:23 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2022-jeep-cherokee-x-zu63cEZLTBKpbfjMiVObKgvdp
2026-05-29 22:19:26 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 2 pages/min), scraped 47 items (at 3 items/min)
2026-05-29 22:19:31 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-84308' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:19:31 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-84565' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:20:01 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:20:03 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:547a50feb745249d5f116aab413dd2d5
2026-05-29 22:20:05 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:20:05 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2018-gmc-sierra-2500hd-slt-a5I4wke4SWWyBkgZCTQnbwvdp
2026-05-29 22:20:05 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:20:06 [loknow_spiders] INFO: Created: 2 items out of 3
2026-05-29 22:20:26 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 2 pages/min), scraped 48 items (at 1 items/min)
2026-05-29 22:20:30 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-85830' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:20:32 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:20:34 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:cefa91f7f6b73584b0497c4b06ea8c8a
2026-05-29 22:20:37 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:20:37 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2021-jeep-grand-cherokee-high-altitude-6lrgV2B1TsGHjlkcYbCyfgvdp
2026-05-29 22:20:55 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:20:56 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-87158' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:20:57 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:78d885a31526290758ee6b0cd0552ee6
2026-05-29 22:21:00 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:21:00 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2019-toyota-4runner-P4XWSYGcTJmGZGnnbliBZQvdp
2026-05-29 22:21:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-88994' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:21:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-88697' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:21:11 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:21:13 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:d443ac75b355b99769fc1eb100b13707
2026-05-29 22:21:13 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2022-ford-f-150-xlt-0auAyCYXQ1CQq4qrumB5BQvdp
2026-05-29 22:21:13 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:21:13 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:21:24 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:21:25 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:189601c808e0f36813b8886cb5eab9df
2026-05-29 22:21:25 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-90112' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:21:26 [scrapy.extensions.logstats] INFO: Crawled 56 pages (at 3 pages/min), scraped 51 items (at 3 items/min)
2026-05-29 22:21:28 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:21:28 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2024-gmc-sierra-1500-slt-tgr2TRgvSZaAYkEzAHkI3wvdp
2026-05-29 22:21:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-91414' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:21:55 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:21:56 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:2aa7998303372901b62703aef60c634a
2026-05-29 22:21:56 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2022-jeep-grand-wagoneer-series-iii-kNOLup4rRbCehZet7kNixQvdp
2026-05-29 22:22:08 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:22:09 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-92811' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:22:09 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:fbf6e9a28884a8023d2a6729a91b1669
2026-05-29 22:22:09 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2014-hyundai-santa-fe-sport-se-Bv0LwB06QgS12qpMKld98gvdp
2026-05-29 22:22:26 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 3 pages/min), scraped 54 items (at 3 items/min)
2026-05-29 22:22:33 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:22:34 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-94265' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:22:34 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:46d4ec449ec21e8c8814f8be09bc1b72
2026-05-29 22:22:34 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2018-volkswagen-tiguan-trendline-45gijqfTTbmK2Dnt8yHvngvdp
2026-05-29 22:22:34 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:22:34 [loknow_spiders] INFO: Created: 4 items out of 4
2026-05-29 22:22:46 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-96106' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:22:46 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-95804' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:23:02 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:23:03 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:af2a1de0dd3950f912e457fc917a538c
2026-05-29 22:23:06 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:23:06 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2022-chevrolet-equinox-rs-G0xUTrD1SUSGxu1AJZ6F0Avdp
2026-05-29 22:23:21 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:23:21 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-97262' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:23:21 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:c81a02b985b860668f068e63f5dad86f
2026-05-29 22:23:21 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2024-toyota-sequoia-platinum-ixPoORUOR1OfNT9sWhsNlAvdp
2026-05-29 22:23:24 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-98574' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:23:24 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-98886' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:23:26 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 2 pages/min), scraped 57 items (at 3 items/min)
2026-05-29 22:23:39 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:23:40 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:22c758b106317ad5f3ce45b2c630c4ab
2026-05-29 22:23:43 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:23:43 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2014-jeep-grand-cherokee-overland-mPcebIRQSNOrgIQzwhF6iwvdp
2026-05-29 22:23:43 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:23:44 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:23:59 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-100056' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:24:08 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:24:08 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:720be5fb449ede8200584292e30f7f1e
2026-05-29 22:24:08 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2023-gmc-sierra-1500-denali-ultimate-iWZilVkrSOWjkj4PMIyFywvdp
2026-05-29 22:24:13 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-101474' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:24:13 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-101740' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:24:26 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 3 pages/min), scraped 59 items (at 2 items/min)
2026-05-29 22:24:29 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:24:30 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:8006db767755e446c88f64fba063f089
2026-05-29 22:24:32 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:24:32 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2023-buick-enclave-premium-f2omhxk5SBejD1ukzeZw9wvdp
2026-05-29 22:24:40 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-102916' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:24:55 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:24:55 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:8fedffc72c4d82657201f1d18dd0da23
2026-05-29 22:24:55 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2019-chevrolet-traverse-premier-nxEZjUqXQoGHVdb2BnKWfwvdp
2026-05-29 22:24:55 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:24:56 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:25:18 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:25:18 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-104242' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:25:18 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-104514' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:25:19 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:c4e0e21ee43ab95dd9bd3755f56d7599
2026-05-29 22:25:22 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:25:22 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-lt-trail-boss-yHtlSc7kTRKZdNvtDsjAWgvdp
2026-05-29 22:25:26 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 2 pages/min), scraped 62 items (at 3 items/min)
2026-05-29 22:25:37 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-105723' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:25:46 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:25:47 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:67682bd36f3337927a69611b40878dd3
2026-05-29 22:25:54 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:25:54 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-Tl3ousukTAW4YiKSl76VnAvdp
2026-05-29 22:26:01 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:26:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-107440' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:26:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-107142' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:26:02 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:316994e4c7ffd8d4b549adbf2bf8fcb0
2026-05-29 22:26:07 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:26:07 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-sle-LpBqjbD5RleGuYyeuhFqhwvdp
2026-05-29 22:26:07 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:26:08 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:26:22 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:26:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-108683' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:26:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-109026' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:26:23 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:74200914db5946c32aa1456e70a8d877
2026-05-29 22:26:26 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:26:26 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-preferred-E3m7BaUxTLWtyWSagsYyKQvdp
2026-05-29 22:26:26 [scrapy.extensions.logstats] INFO: Crawled 69 pages (at 3 pages/min), scraped 65 items (at 3 items/min)
2026-05-29 22:26:45 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:26:45 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-110307' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:26:46 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:5eb1002174b9a01a3558a117918aaea9
2026-05-29 22:26:46 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-sport-touring-D0mddWoUTV2sBOncC6Cf9Qvdp
2026-05-29 22:27:11 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:27:11 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-111893' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:27:12 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:8b40aec25c66683d7b1bc7ba4b42dba7
2026-05-29 22:27:16 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:27:16 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-sport-touring-uhcsArbeSbmtCEUrS1GcoQvdp
2026-05-29 22:27:16 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:27:16 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:27:26 [scrapy.extensions.logstats] INFO: Crawled 72 pages (at 3 pages/min), scraped 67 items (at 2 items/min)
2026-05-29 22:27:36 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:27:37 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-113389' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:27:37 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-113661' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:27:37 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:7dd0a38dcd27035ae0fb3a730ba87063
2026-05-29 22:27:41 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:27:41 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-avenir-C9EBWg6tSA6kaTry2zCFXAvdp
2026-05-29 22:28:04 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:28:05 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-115026' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:28:06 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:8cd61ff3b53ad6d5f8d50c375801977a
2026-05-29 22:28:11 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:28:11 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-rst-1mDDsUKaR12QrTDpXXXBYgvdp
2026-05-29 22:28:26 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 2 pages/min), scraped 69 items (at 2 items/min)
2026-05-29 22:28:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-116572' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:28:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-116824' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:28:36 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:28:37 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:2eeaf674b5fd176a5d1f0506588f251b
2026-05-29 22:28:37 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-sle-T4qVWzUCR0mFNIbywlP8JQvdp
2026-05-29 22:28:37 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:28:38 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:28:51 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-118014' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:28:51 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-118335' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:28:59 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:29:01 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:22f4f0cf125dae4618a57a63c3a3df7a
2026-05-29 22:29:05 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:29:05 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-silverado-1500-high-country-f28eY2nlRl6KzKAkK7uXMAvdp
2026-05-29 22:29:13 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:29:13 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-119570' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:29:13 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:c72d7911e556b4f8e98a6ffc7af8a765
2026-05-29 22:29:18 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:29:18 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-sle-5cVLGsvaR8WywdLxYaQRIgvdp
2026-05-29 22:29:25 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-121082' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:29:26 [scrapy.extensions.logstats] INFO: Crawled 77 pages (at 3 pages/min), scraped 72 items (at 3 items/min)
2026-05-29 22:29:36 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:29:36 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:67c6c1896372b99f06513f5f5f10faad
2026-05-29 22:29:36 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-EX3Q8SvfTrSZmPNFukQcNQvdp
2026-05-29 22:29:46 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-122856' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:29:46 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-122604' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:30:13 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:30:16 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:94b1d82e9dbeb0ff61c83bacd3a7a526
2026-05-29 22:30:16 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-terrain-awd-elevation-J23lf6MJRUaRBk5Vr272hgvdp
2026-05-29 22:30:16 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:30:16 [loknow_spiders] INFO: Created: 4 items out of 4
2026-05-29 22:30:19 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-124157' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:30:19 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-124431' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:30:26 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 2 pages/min), scraped 74 items (at 2 items/min)
2026-05-29 22:30:32 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:30:33 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:ec0b19aad51c8324f8338d9ae42015b1
2026-05-29 22:30:36 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:30:36 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-equinox-awd-lt-i2CQYpAiTce9skFiaA4tLQvdp
2026-05-29 22:30:41 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:30:42 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-125756' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:30:42 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:30373466f708999b9d286d2567087292
2026-05-29 22:30:46 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:30:46 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-2a1S2e9zQVOoolsGG8iBaAvdp
2026-05-29 22:31:07 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-127183' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:31:08 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:31:09 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:78d2b9a064549fdc234f27ff3a5d8572
2026-05-29 22:31:09 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-sport-touring-a93qkkQGTOyLyM2Ap0vkSwvdp
2026-05-29 22:31:12 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-128780' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:31:12 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-129023' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:31:26 [scrapy.extensions.logstats] INFO: Crawled 82 pages (at 3 pages/min), scraped 77 items (at 3 items/min)
2026-05-29 22:31:30 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:31:30 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:cc11ad26ccd28db41ae41bce85f3a742
2026-05-29 22:31:37 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:31:37 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-pro-QZerztBfQJGN2wqmJnr4xwvdp
2026-05-29 22:31:37 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:31:38 [loknow_spiders] INFO: Created: 4 items out of 4
2026-05-29 22:31:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-130285' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:31:49 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-130530' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:31:58 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:31:59 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:32e31d21c10d48a261051c75b3bdc9b3
2026-05-29 22:32:04 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:32:04 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-buick-envision-sport-touring-MnaIGsu5QFS2B7wkcknFBwvdp
2026-05-29 22:32:17 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:32:17 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-131931' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:32:18 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:d94dd255c44c7681025cb9f7d5c52a93
2026-05-29 22:32:18 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-traverse-z71-9Ueo5al9TSOskAgMdtELxgvdp
2026-05-29 22:32:26 [scrapy.extensions.logstats] INFO: Crawled 85 pages (at 3 pages/min), scraped 80 items (at 3 items/min)
2026-05-29 22:32:38 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:32:39 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-133394' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:32:39 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:ee0b54d7af262490b876578eb2ff62f3
2026-05-29 22:32:44 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:32:44 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-denali-tN1AK5ObT7CDNQBF5Q6FDAvdp
2026-05-29 22:32:44 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:32:45 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:32:47 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:32:47 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-134926' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:32:47 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-135268' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:32:48 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:e35c82c7b2ad7ade381311b29e42bab6
2026-05-29 22:32:52 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:32:52 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-traverse-lt-ye7QiadtQq2lj1ZLF2t2XQvdp
2026-05-29 22:33:00 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-136575' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:33:11 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:33:12 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:1cad779de8715118600e90e9a5db3dcf
2026-05-29 22:33:12 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-elevation-LVm12m3cRl2kp3C0iB3p0gvdp
2026-05-29 22:33:22 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-138087' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:33:26 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 2 pages/min), scraped 83 items (at 3 items/min)
2026-05-29 22:33:45 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:33:46 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:8acacb020915877d3ebe6e8c6a5a7e75
2026-05-29 22:33:52 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:33:52 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-1500-at4x-KOZehmKuRhyW3WSCm3bIkwvdp
2026-05-29 22:33:52 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:33:53 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:34:02 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:34:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-139593' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:34:02 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-139833' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:34:03 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:936ecd7497f10fa014649b23621df80f
2026-05-29 22:34:06 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:34:06 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-at4-o9rERlOfQMSM7bIUpGHuiwvdp
2026-05-29 22:34:22 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:34:23 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-141222' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:34:23 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:8d80dadbbd2fecd4234752bb9be2d563
2026-05-29 22:34:23 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-tahoe-rst-HRkhrVNWRRimFz4ALodOuAvdp
2026-05-29 22:34:26 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-142636' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:34:26 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 3 pages/min), scraped 86 items (at 3 items/min)
2026-05-29 22:34:46 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:34:47 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:5f6ea8daa0e710058d4fff61742afa18
2026-05-29 22:34:47 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-canyon-elevation-mwJLsgwlR62MPEt7pI2DGAvdp
2026-05-29 22:35:15 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:35:15 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-144004' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:35:15 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-144270' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:35:16 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:3a2663631161b760fbf9e714301df19b
2026-05-29 22:35:19 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:35:19 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-terrain-fwd-elevation-NbMk9LS4SomIGhUOxpYEdQvdp
2026-05-29 22:35:19 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:35:19 [loknow_spiders] INFO: Created: 4 items out of 4
2026-05-29 22:35:24 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-145627' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:35:26 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 2 pages/min), scraped 88 items (at 2 items/min)
2026-05-29 22:35:43 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:35:44 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:bc0234c2c4602d61e6e168b4a3e7fdf4
2026-05-29 22:35:44 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-chevrolet-equinox-awd-lt-zVoHY3j1RSqXAeZakjTswQvdp
2026-05-29 22:36:07 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:36:07 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-147177' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:36:08 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:f9025a2b21a2815593696491518acbcc
2026-05-29 22:36:08 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-mSKjt212SSCVqcZyT4xMXgvdp
2026-05-29 22:36:26 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 3 pages/min), scraped 90 items (at 2 items/min)
2026-05-29 22:36:32 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:36:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-148774' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:36:33 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:3eb97ccde4a32608960c60a1846757c1
2026-05-29 22:36:33 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-8qP2swIQSmy2uKIlc2iTugvdp
2026-05-29 22:36:33 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:36:34 [loknow_spiders] INFO: Created: 3 items out of 3
2026-05-29 22:37:05 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:37:06 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-150224' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:37:06 [loknow_spiders] INFO: Cache: missed loknow_spiders:gpt-response-cache:e908d9545873716389e9eb775f339628
2026-05-29 22:37:16 [httpx] INFO: HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2026-05-29 22:37:16 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-sierra-3500hd-denali-3qlzt0krR9GQQksSURy0LAvdp
2026-05-29 22:37:26 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 2 pages/min), scraped 92 items (at 2 items/min)
2026-05-29 22:37:31 [StrathmoremotorsSpider] INFO: Closed Playwright page
2026-05-29 22:37:31 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-151708' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:37:32 [loknow_spiders] INFO: Cache: hit loknow_spiders:gpt-response-cache:a7c714c3973c4046e0af369608351a41
2026-05-29 22:37:32 [StrathmoremotorsSpider] INFO: Processed https://strathmoremotors.com/inventory/2026-gmc-terrain-awd-denali-sAlu74X9SxaRtWa66fmRcQvdp
2026-05-29 22:37:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-05-29 22:37:32 [root] INFO: Making post request to https://api.adretriever.com/api/import/e3d66172
2026-05-29 22:37:32 [loknow_spiders] INFO: Created: 2 items out of 2
2026-05-29 22:37:32 [loknow_spiders] INFO: GPT cache hit rate: 47.31182795698925%
2026-05-29 22:37:32 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (93 items) in: file:///home/scrapyd/items/loknow_spiders_prod/StrathmoremotorsSpider/631701885ba811f1bdc0c3bbae71ecef.jl
2026-05-29 22:37:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 8,
 'downloader/exception_type_count/playwright._impl._errors.TimeoutError': 8,
 'downloader/request_bytes': 54096,
 'downloader/request_count': 105,
 'downloader/request_method_count/GET': 105,
 'downloader/response_bytes': 132504025,
 'downloader/response_count': 97,
 'downloader/response_status_count/200': 97,
 'dupefilter/filtered': 202,
 'elapsed_time_seconds': 2826.115953,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 5, 29, 22, 37, 32, 938431),
 'httpcompression/response_bytes': 1440,
 'httpcompression/response_count': 2,
 'item_scraped_count': 93,
 'log_count/ERROR': 134,
 'log_count/INFO': 480,
 'log_count/WARNING': 1,
 'memusage/max': 267194368,
 'memusage/startup': 125448192,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 103,
 'playwright/page_count/max_concurrent': 4,
 'playwright/request_count': 26593,
 'playwright/request_count/method/GET': 23059,
 'playwright/request_count/method/POST': 3534,
 'playwright/request_count/navigation': 1323,
 'playwright/request_count/resource_type/document': 1323,
 'playwright/request_count/resource_type/eventsource': 101,
 'playwright/request_count/resource_type/fetch': 1994,
 'playwright/request_count/resource_type/font': 1485,
 'playwright/request_count/resource_type/image': 4076,
 'playwright/request_count/resource_type/other': 196,
 'playwright/request_count/resource_type/ping': 1051,
 'playwright/request_count/resource_type/script': 8939,
 'playwright/request_count/resource_type/stylesheet': 5058,
 'playwright/request_count/resource_type/xhr': 2370,
 'playwright/response_count': 26248,
 'playwright/response_count/method/GET': 22830,
 'playwright/response_count/method/POST': 3418,
 'playwright/response_count/resource_type/document': 1241,
 'playwright/response_count/resource_type/eventsource': 101,
 'playwright/response_count/resource_type/fetch': 1879,
 'playwright/response_count/resource_type/font': 1484,
 'playwright/response_count/resource_type/image': 4069,
 'playwright/response_count/resource_type/other': 194,
 'playwright/response_count/resource_type/ping': 1050,
 'playwright/response_count/resource_type/script': 8817,
 'playwright/response_count/resource_type/stylesheet': 5049,
 'playwright/response_count/resource_type/xhr': 2364,
 'request_depth_max': 1,
 'response_received_count': 97,
 'robotstxt/request_count': 2,
 'robotstxt/response_count': 2,
 'robotstxt/response_status_count/200': 2,
 'scheduler/dequeued': 103,
 'scheduler/dequeued/memory': 103,
 'scheduler/enqueued': 103,
 'scheduler/enqueued/memory': 103,
 'start_time': datetime.datetime(2026, 5, 29, 21, 50, 26, 822478)}
2026-05-29 22:37:32 [scrapy.core.engine] INFO: Spider closed (finished)
2026-05-29 22:37:32 [scrapy-playwright] INFO: Closing download handler
2026-05-29 22:37:32 [scrapy-playwright] INFO: Closing download handler
2026-05-29 22:37:32 [scrapy-playwright] INFO: Closing browser
2026-05-29 22:37:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-153474' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>
2026-05-29 22:37:33 [asyncio] ERROR: Task was destroyed but it is pending!
task: <Task pending name='Task-153208' coro=<ScrapyPlaywrightDownloadHandler._get_response_and_download.<locals>._handle_response() running at /home/scrapyd/venv/lib/python3.10/site-packages/scrapy_playwright/handler.py:524> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[AsyncIOEventEmitter._emit_run.<locals>.callback() at /home/scrapyd/venv/lib/python3.10/site-packages/pyee/asyncio.py:97]>

PROJECT (loknow_spiders_prod)
SPIDER (StrathmoremotorsSpider)