-
Head
2026-05-29 22:27:53 [scrapy.utils.log] INFO: Scrapy 2.10.0 started (bot: retriever)
2026-05-29 22:27:53 [scrapy.utils.log] INFO: Versions: lxml 5.1.0.0, libxml2 2.12.3, cssselect 1.2.0, parsel 1.9.0, w3lib 2.0.0, Twisted 22.4.0, Python 3.10.12 (main, Mar 3 2026, 11:56:32) [GCC 11.4.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.5, Platform Linux-6.8.0-1030-aws-x86_64-with-glibc2.35
2026-05-29 22:27:53 [scrapy.addons] INFO: Enabled addons:
[]
2026-05-29 22:27:53 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
'BOT_NAME': 'retriever',
'HTTPCACHE_EXPIRATION_SECS': 86400,
'IMAGES_STORE_S3_ACL': 'public-read',
'LOG_FILE': '/home/scrapyd/logs/loknow_spiders_prod/ImageSpider/9dfeff4e5bad11f1bdc0c3bbae71ecef.log',
'LOG_FORMATTER': 'loknow_spiders.logging.PoliteLogFormatter',
'LOG_LEVEL': 'INFO',
'NEWSPIDER_MODULE': 'loknow_spiders.spiders',
'SPIDER_MODULES': ['loknow_spiders.spiders'],
'TELNETCONSOLE_ENABLED': False,
'USER_AGENT': 'AdRetriever (https://adretriever.com)'}
2026-05-29 22:27:53 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/utils/request.py:248: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.
It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.
See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
return cls(crawler)
2026-05-29 22:27:53 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.throttle.AutoThrottle']
2026-05-29 22:27:53 [ImageSpider] INFO: Current Spider Environment set to: prod
2026-05-29 22:27:53 [ImageSpider] INFO: Retrieving AWS secret: spider_prod_secrets
2026-05-29 22:27:53 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 22:27:54 [ImageSpider] INFO: In base spider ml_kwargs is None and scrape_type is inventory
2026-05-29 22:27:54 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'loknow_spiders.middlewares.ThrottlingRetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-29 22:27:54 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'loknow_spiders.middlewares.RetrieverSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-05-29 22:27:54 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 22:27:54 [scrapy.middleware] INFO: Enabled item pipelines:
['loknow_spiders.pipelines.ImageUrlsValidationPipeline']
2026-05-29 22:27:54 [scrapy.core.engine] INFO: Spider opened
2026-05-29 22:27:54 [loknow_spiders] INFO: Scrape ID: cd9d7dc2
2026-05-29 22:27:54 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 22:28:12 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:12 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:13 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:19 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/pipelines/images.py:154: ScrapyDeprecationWarning: ImageUrlsValidationPipeline.convert_image() method overridden in a deprecated way, overridden method does not accept response_body argument.
warnings.warn(
2026-05-29 22:28:19 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdcc0cb91b12a4ec4b95e47bd423d5a69A.webp?v=1738803005
2026-05-29 22:28:20 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0e86f53d7ff4f8f968be229664c14f92.webp?v=1738803005
2026-05-29 22:28:25 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0b5b3226ac345b9b4dd2066ccedc968K.webp?v=1738801511
2026-05-29 22:28:26 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sd9d1b682787845bdb66f3df65e964fe4O.webp?v=1738810206
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdd1f8a9a97a04d7eaee1b42261447c75e.webp?v=1738802764
2026-05-29 22:28:33 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4da4e91cab7a40d0b2ed3f642ec972c2w.webp?v=1738801513
2026-05-29 22:28:37 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hfe33aee0357043bdbbb012453a2c929co.webp?v=1738803008
2026-05-29 22:28:42 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H098dec3aed484d9499273196d996d0a8f.webp?v=1738803007
2026-05-29 22:28:43 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4d1e031cb8df4d85b4cec8dddd74b925c.webp?v=1738803007
2026-05-29 22:28:45 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf4e093b4776a400996be56d91c7ea0943.webp?v=1738801163
2026-05-29 22:28:48 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5955c69ddf0641dab3917cf21655e894F.webp?v=1738864820
2026-05-29 22:28:48 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S72c7efff8a534907968ce12fa900c8b4r.webp?v=1738864821
2026-05-29 22:28:49 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4e69e3693b644cb0894dc289f42bd2bbn.webp?v=1738864821
2026-05-29 22:28:49 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa88e383f589544acaf690dd1ce71d99bz.webp?v=1738864820
2026-05-29 22:28:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-05-29 22:28:49 [ImageSpider] INFO: RetrieverAPI is making requests to https://api.adretriever.com with headers {'Authorization': 'Token 96dfb640234f1d676d6fa726f8eae6e7aab44cda'}
2026-05-29 22:28:49 [root] INFO: Making post request to https://api.adretriever.com/api/validated_urls/cd9d7dc2
2026-05-29 22:28:50 [loknow_spiders] INFO: Cache hit rate: 92.0%
2026-05-29 22:28:50 [loknow_spiders] INFO: Cached images: 8cfd5e2b9e0fa2c48b3_1777407889: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H0563e014435d4be2bf4b12df33aea159Y.webp?v=1738801517
5ebff50b82270d26ffd_1778882046: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hcf8c819db8874cdbb5f5803e72ce3cd9Y.webp?v=1738801516
176b98ea7be65302f86_1778882049: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H9935036a69c84673b16b83b6df9936e0y.webp?v=1738801516
d85f8699f679e76f550_1779314794: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H74fdbf4ebb96435584a672ff2ab17171J.webp?v=1738801516
bcce37265c5912c11df_1778187831: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H3161dc15050342a3ac4da856798e52e4V.webp?v=1738801518
9219c5f598d0920e035_1780007258: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H94835a22bc5e401583ebe574d0a4a7b3H.webp?v=1738801517
af89f0454366e362ab7_1777581582: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2b409d2c4dc344858e3d4d756a9712a16.webp?v=1738801513
a7fa0fc9a7cd38370fd_1780007258: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4b0ae0339c3e477e838e87ba42e44b8au.webp?v=1738801512
8957eafc023e68f6174_1778708942: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sbc1df9780a704818aab0e466daaf2190Q_ebf9dcb5-9df8-4d21-9df3-bd1b1288f3f6.webp?v=1738801510
0992108c895283b1c9b_1778795518: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S0cc34b67b1f747b28098505eb93c8633e.webp?v=1738801510
1d75ed9351acd598078_1780007260: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S8370fb2784ad45a6915a4cb7b3289f943.webp?v=1738801510
0b8829bb189cbfca007_1779314819: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf6352981f9184e9e85a79dcde5178c0a4.webp?v=1738801510
9cc660bd53868b7917d_1778708949: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S017f52137a5b4e43bf97baa8640b62d8z.webp?v=1738801510
7a758ca8e1a7fd02af9_1780007261: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S18447dfb281a4952a7fdf4feaaf10be9t_e7f11961-9e95-4f7d-aece-8fa46ce5dfdc.webp?v=1738801510
ae8432120f4cfbd34c9_1777754710: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S08d616341e324bd395f361529333e38dA.webp?v=1738801510
dba182d1913a1e07778_1778708950: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S77dbf0fe32eb46eeaa85af45dd8804b2z.webp?v=1738801510
c5f2920c739b522f04c_1778795526: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S7f7a65405da740f4ad0aa4873b21e88ec.webp?v=1738801512
c89fdf3527c75e9a9cb_1778014565: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S57ce868f168f492e85a13a4a73dfdeebj.webp?v=1738801512
4ff8ed667082d217642_1779574633: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S1413887ad43146298ce75f9e3a9ce2f9g.webp?v=1738801512
-
Tail
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-29 22:27:54 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'loknow_spiders.middlewares.RetrieverSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-05-29 22:27:54 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 22:27:54 [scrapy.middleware] INFO: Enabled item pipelines:
['loknow_spiders.pipelines.ImageUrlsValidationPipeline']
2026-05-29 22:27:54 [scrapy.core.engine] INFO: Spider opened
2026-05-29 22:27:54 [loknow_spiders] INFO: Scrape ID: cd9d7dc2
2026-05-29 22:27:54 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 22:28:12 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:12 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:13 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
2026-05-29 22:28:19 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/pipelines/images.py:154: ScrapyDeprecationWarning: ImageUrlsValidationPipeline.convert_image() method overridden in a deprecated way, overridden method does not accept response_body argument.
warnings.warn(
2026-05-29 22:28:19 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdcc0cb91b12a4ec4b95e47bd423d5a69A.webp?v=1738803005
2026-05-29 22:28:20 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0e86f53d7ff4f8f968be229664c14f92.webp?v=1738803005
2026-05-29 22:28:25 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0b5b3226ac345b9b4dd2066ccedc968K.webp?v=1738801511
2026-05-29 22:28:26 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sd9d1b682787845bdb66f3df65e964fe4O.webp?v=1738810206
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
2026-05-29 22:28:27 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdd1f8a9a97a04d7eaee1b42261447c75e.webp?v=1738802764
2026-05-29 22:28:33 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4da4e91cab7a40d0b2ed3f642ec972c2w.webp?v=1738801513
2026-05-29 22:28:37 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hfe33aee0357043bdbbb012453a2c929co.webp?v=1738803008
2026-05-29 22:28:42 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H098dec3aed484d9499273196d996d0a8f.webp?v=1738803007
2026-05-29 22:28:43 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4d1e031cb8df4d85b4cec8dddd74b925c.webp?v=1738803007
2026-05-29 22:28:45 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf4e093b4776a400996be56d91c7ea0943.webp?v=1738801163
2026-05-29 22:28:48 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5955c69ddf0641dab3917cf21655e894F.webp?v=1738864820
2026-05-29 22:28:48 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S72c7efff8a534907968ce12fa900c8b4r.webp?v=1738864821
2026-05-29 22:28:49 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4e69e3693b644cb0894dc289f42bd2bbn.webp?v=1738864821
2026-05-29 22:28:49 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa88e383f589544acaf690dd1ce71d99bz.webp?v=1738864820
2026-05-29 22:28:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-05-29 22:28:49 [ImageSpider] INFO: RetrieverAPI is making requests to https://api.adretriever.com with headers {'Authorization': 'Token 96dfb640234f1d676d6fa726f8eae6e7aab44cda'}
2026-05-29 22:28:49 [root] INFO: Making post request to https://api.adretriever.com/api/validated_urls/cd9d7dc2
2026-05-29 22:28:50 [loknow_spiders] INFO: Cache hit rate: 92.0%
2026-05-29 22:28:50 [loknow_spiders] INFO: Cached images: 8cfd5e2b9e0fa2c48b3_1777407889: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H0563e014435d4be2bf4b12df33aea159Y.webp?v=1738801517
5ebff50b82270d26ffd_1778882046: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hcf8c819db8874cdbb5f5803e72ce3cd9Y.webp?v=1738801516
176b98ea7be65302f86_1778882049: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H9935036a69c84673b16b83b6df9936e0y.webp?v=1738801516
d85f8699f679e76f550_1779314794: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H74fdbf4ebb96435584a672ff2ab17171J.webp?v=1738801516
bcce37265c5912c11df_1778187831: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H3161dc15050342a3ac4da856798e52e4V.webp?v=1738801518
9219c5f598d0920e035_1780007258: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H94835a22bc5e401583ebe574d0a4a7b3H.webp?v=1738801517
af89f0454366e362ab7_1777581582: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2b409d2c4dc344858e3d4d756a9712a16.webp?v=1738801513
a7fa0fc9a7cd38370fd_1780007258: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4b0ae0339c3e477e838e87ba42e44b8au.webp?v=1738801512
8957eafc023e68f6174_1778708942: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sbc1df9780a704818aab0e466daaf2190Q_ebf9dcb5-9df8-4d21-9df3-bd1b1288f3f6.webp?v=1738801510
0992108c895283b1c9b_1778795518: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S0cc34b67b1f747b28098505eb93c8633e.webp?v=1738801510
1d75ed9351acd598078_1780007260: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S8370fb2784ad45a6915a4cb7b3289f943.webp?v=1738801510
0b8829bb189cbfca007_1779314819: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf6352981f9184e9e85a79dcde5178c0a4.webp?v=1738801510
9cc660bd53868b7917d_1778708949: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S017f52137a5b4e43bf97baa8640b62d8z.webp?v=1738801510
7a758ca8e1a7fd02af9_1780007261: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S18447dfb281a4952a7fdf4feaaf10be9t_e7f11961-9e95-4f7d-aece-8fa46ce5dfdc.webp?v=1738801510
ae8432120f4cfbd34c9_1777754710: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S08d616341e324bd395f361529333e38dA.webp?v=1738801510
dba182d1913a1e07778_1778708950: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S77dbf0fe32eb46eeaa85af45dd8804b2z.webp?v=1738801510
c5f2920c739b522f04c_1778795526: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S7f7a65405da740f4ad0aa4873b21e88ec.webp?v=1738801512
c89fdf3527c75e9a9cb_1778014565: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S57ce868f168f492e85a13a4a73dfdeebj.webp?v=1738801512
4ff8ed667082d217642_1779574633: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S1413887ad43146298ce75f9e3a9ce2f9g.webp?v=1738801512
c50465068659bd39463_1778535195: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S1d802692b05246a6b84a71aaef2a5a61I.webp?v=1738803004
8325a111ad42adbe277_1779141986: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hdc1226840fc9453bb3f5f1b248affed6t_b7578901-6b24-4273-aa59-9eb212f6b410.webp?v=1738801163
f69284d2a025cdab9c1_1778708955: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H468a558fc0af4ecc81304a04662e75c2d.webp?v=1738801516
e343b0ed22d3de3ddbe_1780007265: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H6c19ff5c97d4463f8da0c7e65fd253cbT.webp?v=1738801515
c024b06154dd9d87f53_1779314830: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H713d402a229a419b841afa65859b169f0.webp?v=1738801516
13398532e1e42f4830f_1779314833: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hd6bfb91a05c140f2862704801a50ac2f3.webp?v=1738801515
d3791c6526d158250e4_1780093689: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
0d24b27f2e1da8a8760_1779141988: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hb21d7fcc096c45559bb46cca89f78f978.webp?v=1738801516
bbe6fff8fbe6ae0fe33_1779574636: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S596d5f4428d447338e067b2da647f612A.webp?v=1738801511
fe5e1811f45e9a86c21_1779574637: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S92e134d53bc2460288be141e32a9dedag.webp?v=1738801511
56c21f80de1c8564663_1777581593: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2f9620fcbae14c2280e7a0a902671adbN.webp?v=1738801511
99e82f1992aecdbaf38_1778187861: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5506c64371354d47b9d966e6b02c777fn.webp?v=1738801511
244d3622175ff2d8bf7_1778708969: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sd2889819e958499db475695c5591421ew.webp?v=1738801511
d5fce7cd7cdf8a5ea16_1778969036: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sfaa81f474d0c45eb9be60ab4ea64ec77v.webp?v=1738801511
97f1d161145e7d7a45b_1780007274: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S22834484e52246749c51afaa3c1823e2g.webp?v=1738801511
040e24490949ffd910a_1778969036: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sb479b6aaf011448eaa9df37111fc5f7b7.webp?v=1738801511
b2517e829e1cae3ebdd_1779314849: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S8e86fe3b494043f1b6a81e7e8cee6fed3.webp?v=1738810205
76f2772281afccc2764_1777407914: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S123182c69e524c3b88b1f6011d21f4e27.webp?v=1738801509
a1f30f216ae8cee5f84_1779574640: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa60efc58fa4141b4a1ee1d6f8a41196bt.webp?v=1738809975
7bde9dc3ae85cabd2b4_1779314854: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Scd0fc2fd506046bda02bf0e1a8995c90V.webp?v=1738802764
210e47c5531ad458632_1779314854: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S605949ed0feb45d2a7572f99d634dc1fs.webp?v=1738802764
f15617b2fb161663dee_1779314855: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S43d0d9b7721749bba65f789204c721549.webp?v=1738802764
ef15816ca078b1329ee_1778708973: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S12b542fdb6a44d0391929f5b97d93571g.webp?v=1738802764
d165401773f3629afc1_1779574643: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0e5e40c0e624f9b83dabeb648345304h.webp?v=1738801513
f129e57903def5c707e_1778708973: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf3668075346d43689e64c9d1dbb7e229u.webp?v=1738801513
b63209c4018952d9bd8_1778274758: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S246808aa24c240d7a45388518576c14fA.webp?v=1738801514
c65adb8507b49a812c7_1778708975: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S38321a2e0d9c49b0a364de45cbc2861df.webp?v=1738801513
4f9bc21a08b921bfad0_1777581599: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S41f673ac479d46baab518c0a2c5f19cf7.webp?v=1738801513
b06404d33bd5b48827c_1779314858: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S035df33ad7a546958c8007d4b94e69bf6.webp?v=1738801513
308c71c6e9063ba6f83_1779314858: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sc96be0d2613a479b965db9150453e3f31.webp?v=1738801513
3ef2835c716dc1d6848_1778969042: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sb4cf8b634c2147dab5d8816303a3a145l.webp?v=1738801513
4c215eeec6f056e5e87_1777581601: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Se3818294036c482f959f670929cfb60eV.webp?v=1738802269
daea3d8f6fcd8b44a51_1778014600: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S45df9fbb500a48728f62290a0a86dbca4_7d8a8de5-357e-4736-b230-629009bb48bc.webp?v=1738802269
c3eee3a45d9174a3978_1779142003: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S53f57da6064f401d88b828583ec54b55H.webp?v=1738810206
788889d02d05fb3e4fb_1779401787: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S1a394c2094744a2a8d004e1d1953a266U.webp?v=1738809975
44bc6d0b054feaf7308_1777407920: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H17e42dc8b037450b860ac09e5643eb29n.webp?v=1738803007
73f278d1c17608d4a02_1777581603: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H0645ae1f95aa4c07aff52d41c542bfe1z.webp?v=1738803007
dc90313f7cd65071bb4_1778969044: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H43e4959adc1246fba8381a8be0e7c9ad6.webp?v=1738803007
fe3e9ce8057b44aed53_1779574646: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H268471a91a0c42a78bee1f64bdc2de7dB.webp?v=1738803007
f1a3fc28acbaf4fdf82_1779920869: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H8fab75e4a71241db9b4a4ad514cd172dA.webp?v=1738803007
ff9b54953fd834ed14b_1780007285: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hc85e4fb54bb745338bd8242667636a8aY.webp?v=1738803007
14fb0d22bea47914a42_1779314870: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H47d75188108d4fb1b6a11df324318f5fr.webp?v=1738803007
0e7160da4e69909f2cd_1778622171: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H0b978a4fa31c42a9873fe1b8e85e8fd7I.webp?v=1738803007
796bc68e7b3ff0681e2_1780007286: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Ha3fcdcdd15874da2957724d9aaaf0daeT.webp?v=1738803007
9ee955026c96dc678bc_1778969047: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H64f395f421cb455a9e938e2248b35de2Y.webp?v=1738803007
8f76aaf3a5ae49f64af_1778622173: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4a6998dc08f446cdadcc9b8b955894beh.webp?v=1738803008
9c4387f408af6c46551_1778535250: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H79906f5e56914e7ea4b1ec6be2eeb944I.webp?v=1738803007
d5bc72210b4188dce73_1778708987: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4ade6783cd894b76bb9ec04c43489c51w.webp?v=1738803007
4c1681406e41a827bc0_1778882116: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H81d4d363fe1748f5b818bf013e325d84L.webp?v=1738803007
67fff98f7c73aed4c5f_1778795562: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hc9e3e99c6574491ea8373941a95d4e4fe.webp?v=1738803007
dbb7f9f19ebf32567b9_1777581608: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hc1af5df6a8fa4e0dac8c086754be3192y.webp?v=1738803007
5a9106fe3bcd79629fe_1779142008: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hc86df8f1162d47b7846289a58fbabe8dl.webp?v=1738803007
fa7c1dfbbc9c43566ae_1778622177: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H1cd298aa9fac4ddb97d578f538aa302bn.webp?v=1738803007
f52475ad8630c0c0b06_1779314875: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hfd357ba05faf456eb83fe257352b4fb1t.webp?v=1738803007
d8424f73b1bb2b908b0_1778882119: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hd16f31272e7f4fbd95088bacc2554efaN.webp?v=1738803007
0556fcb6ebf17454063_1778622179: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hdea52f11369448779a7cdd21e4ab23c2G.webp?v=1738803007
322d7eb5d9d836abf2e_1778969054: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S355b442286ec46f6a8de5f4942430088x.webp?v=1738801163
65293eb25ccee518f20_1778708991: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S3973dcc3deb84f97b788240d71be4d82B.webp?v=1738801163
92f4d102cadb6a9b686_1780007289: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S881905465e1d40f7bf215dc0f486a519e.webp?v=1738801163
a9efc8d6bfcd78e0773_1778882120: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S80e7a2e52f154be8a64625e121b8026dC.webp?v=1738801163
3ce0bb72ab586fcc3a6_1778882120: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S77bdda344dcc4a02b9e733b8d54cfd88L.webp?v=1738801163
cf0c662317d8b8b544d_1778708993: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S42c335b180364d20bcbbf4cd3c7b2483U.webp?v=1738801163
d17f80e50277eabdb4f_1780007289: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Ha71367ee769144d38dabcccd731cdf0bx_1db744a4-fffa-4c8d-9b6a-37111492afa8.webp?v=1738864814
afc03e243205ed6ff7d_1779401793: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4f30286eb5504d0187e8b3b91b766aae9_0a606e9f-a2a3-4e96-97f5-8697a6f6a9ea.webp?v=1738864814
fcb30e5642ab8387e8a_1779314877: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S8b4910c58e414be3b6c0a8cebd927659x.webp?v=1738864815
7860afd78db95f4b526_1778187893: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S156d7c941f61425986f2cb9039cb3972m.webp?v=1738864815
ef8e2d993fd00b43164_1779401793: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Se624ac1675f346ea8a70b0b98a50eefc0.webp?v=1738864816
a94f45cb179b7fd70aa_1780007291: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Saa79965bc93a4bef9b30ce0d837f5c7bZ.webp?v=1738864821
a796ba1b8f6bcf2d886_1778882124: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S0fbd60b604b541168f5862895592ba01i.webp?v=1738864820
7e73a8dd605a9291389_1780007291: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Scf7027092ea74648bc0eaca99d738e3cH.webp?v=1738864820
96d09e6160bfa7aa9e8_1778795571: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5b397abb2dd849f49d4f2858262de35dC_e2bad4d9-a4a9-4cc7-9ae8-af84c199e5a7.webp?v=1738864820
c28ce59078bc611c626_1778101068: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S59fd4463a7bb454584df6770b193b9658.webp?v=1738864821
7debf0cc22d1a31adc5_1778882127: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sb1781292f0bd47eea7007d4b92adcfeam.webp?v=1738864821
b52a00ccc8ecbec1a5a_1779314882: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S7fbe3261fb074ff48de138759a4ea151w.webp?v=1738864820
65f7321fd2689bbf0e2_1778622189: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sb786aaf66adf4c8888bafba812e4026bM.webp?v=1738864820
9d42d196dfd0db74eef_1780007292: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S7aec886f884645949bfbcd81ca151ae3u.webp?v=1738864821
e1234d4490e766306ba_1779314883: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S18ea83aad01b4d8a9598482a9b9047cdx.webp?v=1738864821
1ae38d3c339cfce7fc9_1780007293: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S23c4eaa0572a46d9b49022db092b2f21i.webp?v=1738864820
f81f1925a3000170dfe_1778969058: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S3193161100de4a29bd07d0d238fde819q.webp?v=1738864820
7782113d94a1224b1bd_1778361328: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4062ba288ae94523a76001758951af94X.webp?v=1738864820
90b0b66da1b75d1fc4a_1779314887: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5346487ea42c4891902a00eef351d62dT.webp?v=1738864820
4e790b0620820676640_1778187902: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S0059495814634dffaaea357ca2d3c245z.webp?v=1738864820
ea7ec02e3eb67c3c224_1779574653: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Se5f8a41279314a2a924224dea228a5eew.webp?v=1738864820
43f307b72183d0764b5_1780007295: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S396280fe69ca43df8e5c80ac66936161D.webp?v=1738864820
79962b3ad91be6f0d7e_1778969059: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S9aa3288a196c41828b82fcbdcd120b2eT.webp?v=1738864821
af437866b99e2b907dc_1778795575: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S82168839798246efbc02ad34459e0b0ej.webp?v=1738864820
2803c163b22745859dc_1777581621: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S35be81394f864bc69cfed58c60f1e283C.webp?v=1738864820
1af31482735e61bbb3b_1779401796: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa398565d997448ec858233da733635b6R.webp?v=1738864821
cb9bf563f248b935158_1777581623: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5cd6905cab9945cca8ae83266b4d3d94c.webp?v=1738810206
01ab6afa1be9a2f400d_1779314890: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S60743f6e57f9495d8dd300ed1aa05baaD.webp?v=1738810206
7c49e3c7900d255fe55_1777581623: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S0772e34f5ab44d3c94c4235e2e6622f3M.webp?v=1738810206
66d3466af99db8b3fe3_1778709002: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S93623fd5ecfd4dd293829408829872c0a.webp?v=1738810206
2026-05-29 22:28:50 [loknow_spiders] INFO: Uncached images: https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Hfe33aee0357043bdbbb012453a2c929co.webp?v=1738803008
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H098dec3aed484d9499273196d996d0a8f.webp?v=1738803007
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S72c7efff8a534907968ce12fa900c8b4r.webp?v=1738864821
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0b5b3226ac345b9b4dd2066ccedc968K.webp?v=1738801511
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S2319befbcc3e4e17bda61e084802ae3fy.webp?v=1738809975
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4da4e91cab7a40d0b2ed3f642ec972c2w.webp?v=1738801513
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sf4e093b4776a400996be56d91c7ea0943.webp?v=1738801163
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sd9d1b682787845bdb66f3df65e964fe4O.webp?v=1738810206
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa88e383f589544acaf690dd1ce71d99bz.webp?v=1738864820
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S5955c69ddf0641dab3917cf21655e894F.webp?v=1738864820
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H627ea761227947529c1495e369eef8f1m.webp?v=1738801515
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdcc0cb91b12a4ec4b95e47bd423d5a69A.webp?v=1738803005
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/S4e69e3693b644cb0894dc289f42bd2bbn.webp?v=1738864821
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sdd1f8a9a97a04d7eaee1b42261447c75e.webp?v=1738802764
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/H4d1e031cb8df4d85b4cec8dddd74b925c.webp?v=1738803007
https://cdn.shopify.com/s/files/1/0928/4527/7476/files/Sa0e86f53d7ff4f8f968be229664c14f92.webp?v=1738803005
2026-05-29 22:28:50 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (250 items) in: file:///home/scrapyd/items/loknow_spiders_prod/ImageSpider/9dfeff4e5bad11f1bdc0c3bbae71ecef.jl
2026-05-29 22:28:50 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 42826,
'downloader/request_count': 141,
'downloader/request_method_count/GET': 15,
'downloader/request_method_count/HEAD': 126,
'downloader/response_bytes': 1695777,
'downloader/response_count': 141,
'downloader/response_status_count/200': 141,
'dupefilter/filtered': 124,
'elapsed_time_seconds': 55.399699,
'feedexport/success_count/FileFeedStorage': 1,
'file_count': 16,
'file_status_count/downloaded': 15,
'file_status_count/uptodate': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 5, 29, 22, 28, 50, 224327),
'item_scraped_count': 250,
'log_count/INFO': 40,
'log_count/WARNING': 2,
'memusage/max': 133718016,
'memusage/startup': 133718016,
'response_received_count': 141,
'scheduler/dequeued': 126,
'scheduler/dequeued/memory': 126,
'scheduler/enqueued': 126,
'scheduler/enqueued/memory': 126,
'start_time': datetime.datetime(2026, 5, 29, 22, 27, 54, 824628)}
2026-05-29 22:28:50 [scrapy.core.engine] INFO: Spider closed (finished)
-
Log
/1/log/utf8/loknow_spiders_prod/ImageSpider/9dfeff4e5bad11f1bdc0c3bbae71ecef/?job_finished=True&ui=mobile
-
Source
https://scrapyd.adretriever.com/logs/loknow_spiders_prod/ImageSpider/9dfeff4e5bad11f1bdc0c3bbae71ecef.log