-
Head
2026-05-29 21:40:49 [scrapy.utils.log] INFO: Scrapy 2.10.0 started (bot: retriever)
2026-05-29 21:40:49 [scrapy.utils.log] INFO: Versions: lxml 5.1.0.0, libxml2 2.12.3, cssselect 1.2.0, parsel 1.9.0, w3lib 2.0.0, Twisted 22.4.0, Python 3.10.12 (main, Mar 3 2026, 11:56:32) [GCC 11.4.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.5, Platform Linux-6.8.0-1030-aws-x86_64-with-glibc2.35
2026-05-29 21:40:49 [scrapy.addons] INFO: Enabled addons:
[]
2026-05-29 21:40:49 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
'BOT_NAME': 'retriever',
'HTTPCACHE_EXPIRATION_SECS': 86400,
'IMAGES_STORE_S3_ACL': 'public-read',
'LOG_FILE': '/home/scrapyd/logs/loknow_spiders_prod/ImageSpider/ed77a9605ba611f1bdc0c3bbae71ecef.log',
'LOG_FORMATTER': 'loknow_spiders.logging.PoliteLogFormatter',
'LOG_LEVEL': 'INFO',
'NEWSPIDER_MODULE': 'loknow_spiders.spiders',
'SPIDER_MODULES': ['loknow_spiders.spiders'],
'TELNETCONSOLE_ENABLED': False,
'USER_AGENT': 'AdRetriever (https://adretriever.com)'}
2026-05-29 21:40:49 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/utils/request.py:248: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.
It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.
See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
return cls(crawler)
2026-05-29 21:40:49 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.throttle.AutoThrottle']
2026-05-29 21:40:49 [ImageSpider] INFO: Current Spider Environment set to: prod
2026-05-29 21:40:49 [ImageSpider] INFO: Retrieving AWS secret: spider_prod_secrets
2026-05-29 21:40:49 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 21:40:49 [ImageSpider] INFO: In base spider ml_kwargs is None and scrape_type is inventory
2026-05-29 21:40:49 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'loknow_spiders.middlewares.ThrottlingRetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-29 21:40:49 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'loknow_spiders.middlewares.RetrieverSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-05-29 21:40:51 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-29 21:40:51 [scrapy.middleware] INFO: Enabled item pipelines:
['loknow_spiders.pipelines.ImageUrlsValidationPipeline']
2026-05-29 21:40:51 [scrapy.core.engine] INFO: Spider opened
2026-05-29 21:40:51 [loknow_spiders] INFO: Scrape ID: e3324522
2026-05-29 21:40:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-29 21:40:51 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/calendula_oil.jpg?v=1724543537
2026-05-29 21:40:58 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/wild_yam_cream.jpg?v=1724544064
2026-05-29 21:41:04 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy19.jpg?v=1724543318
2026-05-29 21:41:11 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy23.jpg?v=1724543373
2026-05-29 21:41:16 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy1.jpg?v=1724543028
2026-05-29 21:41:23 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy2.jpg?v=1724543050
2026-05-29 21:41:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy18.jpg?v=1724543306
2026-05-29 21:41:33 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy20.jpg?v=1724543331
2026-05-29 21:41:40 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy3.jpg?v=1724543067
2026-05-29 21:41:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy4.jpg?v=1724543089
2026-05-29 21:41:51 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 10 pages/min), scraped 10 items (at 10 items/min)
2026-05-29 21:41:52 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy21.jpg?v=1724543346
2026-05-29 21:41:56 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy5.jpg?v=1724543102
2026-05-29 21:42:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy6.jpg?v=1724543115
2026-05-29 21:42:07 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy22.jpg?v=1724543361
2026-05-29 21:42:14 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy7.jpg?v=1724543135
2026-05-29 21:42:18 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy8.jpg?v=1724543150
2026-05-29 21:42:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy9.jpg?v=1724543163
2026-05-29 21:42:31 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy10.jpg?v=1724543178
2026-05-29 21:42:38 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy24.jpg?v=1724543384
2026-05-29 21:42:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy11.jpg?v=1724543197
2026-05-29 21:42:51 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 10 pages/min), scraped 20 items (at 10 items/min)
2026-05-29 21:42:53 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy12.jpg?v=1724543211
2026-05-29 21:43:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy25.jpg?v=1724543395
2026-05-29 21:43:04 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy13.jpg?v=1724543224
2026-05-29 21:43:10 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy14.jpg?v=1724543239
2026-05-29 21:43:17 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy17.jpg?v=1724543293
2026-05-29 21:43:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy15.jpg?v=1724543263
2026-05-29 21:43:30 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy16.jpg?v=1724543278
2026-05-29 21:43:37 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/27e8c698-c53b-4408-b5b4-81d66c5b2217.jpg?v=1721470060
2026-05-29 21:43:43 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/248e9f0a-c80f-4ad7-a70a-4dac3b307431.jpg?v=1721469463
2026-05-29 21:43:50 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Herbal_Joint_Cream.jpg?v=1724546156
2026-05-29 21:43:51 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 10 pages/min), scraped 30 items (at 10 items/min)
2026-05-29 21:44:03 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/ac023dc3-1416-4f57-beb5-51ea477bfa0a_trans.jpg?v=1721469952
2026-05-29 21:44:07 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/219a18ed-88b2-495f-9328-bbab03088e84_trans.jpg?v=1721469940
2026-05-29 21:44:10 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/3fba98d2-77d6-4183-ad83-81c8c7775ebb_trans.jpg?v=1721469959
2026-05-29 21:44:13 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/392870ba-8168-4ae6-abfe-f5f8ba86b736_trans.jpg?v=1721469937
2026-05-29 21:44:16 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/d43797c0-11a1-4736-b5e5-9d8de9e9793a_trans.jpg?v=1721469957
2026-05-29 21:44:18 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/774bfcc6-9a9d-4c6b-a308-57e7d692b8ee_trans.jpg?v=1721469954
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/scalp-nourishing-balm-575856.jpg?v=1724641065
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-vitamin-e-revitalizing-moisturizing-oil-930606.jpg?v=1724641065
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rosemary-hair-growth-serum-636243.jpg?v=1724641078
2026-05-29 21:44:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/refreshing-scalp-rosemary-shampoo-and-conditioner-duo-bars-190363.jpg?v=1724641073
2026-05-29 21:44:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/refreshing-scalp-rosemary-shampoo-and-conditioner-duo-bars-272311.jpg?v=1724641073
2026-05-29 21:44:29 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/pipelines/images.py:154: ScrapyDeprecationWarning: ImageUrlsValidationPipeline.convert_image() method overridden in a deprecated way, overridden method does not accept response_body argument.
-
Tail
2026-05-29 21:40:51 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/calendula_oil.jpg?v=1724543537
2026-05-29 21:40:58 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/wild_yam_cream.jpg?v=1724544064
2026-05-29 21:41:04 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy19.jpg?v=1724543318
2026-05-29 21:41:11 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy23.jpg?v=1724543373
2026-05-29 21:41:16 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy1.jpg?v=1724543028
2026-05-29 21:41:23 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy2.jpg?v=1724543050
2026-05-29 21:41:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy18.jpg?v=1724543306
2026-05-29 21:41:33 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy20.jpg?v=1724543331
2026-05-29 21:41:40 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy3.jpg?v=1724543067
2026-05-29 21:41:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy4.jpg?v=1724543089
2026-05-29 21:41:51 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 10 pages/min), scraped 10 items (at 10 items/min)
2026-05-29 21:41:52 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy21.jpg?v=1724543346
2026-05-29 21:41:56 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy5.jpg?v=1724543102
2026-05-29 21:42:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy6.jpg?v=1724543115
2026-05-29 21:42:07 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy22.jpg?v=1724543361
2026-05-29 21:42:14 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy7.jpg?v=1724543135
2026-05-29 21:42:18 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy8.jpg?v=1724543150
2026-05-29 21:42:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy9.jpg?v=1724543163
2026-05-29 21:42:31 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy10.jpg?v=1724543178
2026-05-29 21:42:38 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy24.jpg?v=1724543384
2026-05-29 21:42:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy11.jpg?v=1724543197
2026-05-29 21:42:51 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 10 pages/min), scraped 20 items (at 10 items/min)
2026-05-29 21:42:53 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy12.jpg?v=1724543211
2026-05-29 21:43:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy25.jpg?v=1724543395
2026-05-29 21:43:04 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy13.jpg?v=1724543224
2026-05-29 21:43:10 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy14.jpg?v=1724543239
2026-05-29 21:43:17 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy17.jpg?v=1724543293
2026-05-29 21:43:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy15.jpg?v=1724543263
2026-05-29 21:43:30 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Aromatherapy16.jpg?v=1724543278
2026-05-29 21:43:37 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/27e8c698-c53b-4408-b5b4-81d66c5b2217.jpg?v=1721470060
2026-05-29 21:43:43 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/248e9f0a-c80f-4ad7-a70a-4dac3b307431.jpg?v=1721469463
2026-05-29 21:43:50 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/Herbal_Joint_Cream.jpg?v=1724546156
2026-05-29 21:43:51 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 10 pages/min), scraped 30 items (at 10 items/min)
2026-05-29 21:44:03 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/ac023dc3-1416-4f57-beb5-51ea477bfa0a_trans.jpg?v=1721469952
2026-05-29 21:44:07 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/219a18ed-88b2-495f-9328-bbab03088e84_trans.jpg?v=1721469940
2026-05-29 21:44:10 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/3fba98d2-77d6-4183-ad83-81c8c7775ebb_trans.jpg?v=1721469959
2026-05-29 21:44:13 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/392870ba-8168-4ae6-abfe-f5f8ba86b736_trans.jpg?v=1721469937
2026-05-29 21:44:16 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/d43797c0-11a1-4736-b5e5-9d8de9e9793a_trans.jpg?v=1721469957
2026-05-29 21:44:18 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/774bfcc6-9a9d-4c6b-a308-57e7d692b8ee_trans.jpg?v=1721469954
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/scalp-nourishing-balm-575856.jpg?v=1724641065
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-vitamin-e-revitalizing-moisturizing-oil-930606.jpg?v=1724641065
2026-05-29 21:44:27 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rosemary-hair-growth-serum-636243.jpg?v=1724641078
2026-05-29 21:44:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/refreshing-scalp-rosemary-shampoo-and-conditioner-duo-bars-190363.jpg?v=1724641073
2026-05-29 21:44:28 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/refreshing-scalp-rosemary-shampoo-and-conditioner-duo-bars-272311.jpg?v=1724641073
2026-05-29 21:44:29 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/pipelines/images.py:154: ScrapyDeprecationWarning: ImageUrlsValidationPipeline.convert_image() method overridden in a deprecated way, overridden method does not accept response_body argument.
warnings.warn(
2026-05-29 21:44:29 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-763698.jpg?v=1724641080
2026-05-29 21:44:30 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-337054.jpg?v=1724641080
2026-05-29 21:44:30 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-921748.jpg?v=1724641081
2026-05-29 21:44:30 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/peppermint-eucalyptus-herbal-toothpaste-552505.jpg?v=1724641065
2026-05-29 21:44:30 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/organic-wild-yam-moisturizing-cream-559559.jpg?v=1724640912
2026-05-29 21:44:30 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/organic-wild-yam-moisturizing-cream-814032.jpg?v=1724640912
2026-05-29 21:44:31 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/organic-wild-yam-moisturizing-cream-889140.jpg?v=1724640912
2026-05-29 21:44:31 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/organic-wild-yam-moisturizing-cream-181100.jpg?v=1724640912
2026-05-29 21:44:31 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/organic-wild-yam-moisturizing-cream-664508.jpg?v=1724640912
2026-05-29 21:44:32 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/nourishing-argan-oil-hair-treatment-mask-331428.jpg?v=1724640911
2026-05-29 21:44:32 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-316926_4ea19772-8659-4ace-aa23-371fd9e9c5eb.jpg?v=1724641075
2026-05-29 21:44:32 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-724238_e7a92f19-ad2a-4d6d-a81f-fc7a0d0fae03.jpg?v=1724641075
2026-05-29 21:44:33 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-824134_fcd47404-5b71-4a6b-96b9-c75c3d366647.jpg?v=1724641075
2026-05-29 21:44:33 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-567064_15b6226a-96d0-447e-ab28-10aac72b5f83.jpg?v=1724641075
2026-05-29 21:44:33 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-961015_69a2eee4-e327-4706-b521-2d79ffa783e6.jpg?v=1724641075
2026-05-29 21:44:34 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/natural-organic-soap-made-with-essential-oils-814978_e68f5250-7411-4b7d-8782-cbc500e2a85a.jpg?v=1724641075
2026-05-29 21:44:36 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/lavender-soothing-sleep-spray-917557.jpg?v=1724640906
2026-05-29 21:44:36 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/lavender-sleep-cream-300136_6eaa3528-a6fb-47ad-9d87-dfe095dbd4f3.jpg?v=1724641071
2026-05-29 21:44:36 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/indian-pagoda-aromatherapy-238314.jpg?v=1724641091
2026-05-29 21:44:37 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/healing-herbal-salve-545254.jpg?v=1724640905
2026-05-29 21:44:39 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-933331.jpg?v=1724641096
2026-05-29 21:44:40 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/deep-cleansing-clay-mask-235928_91d750cb-58d8-4f61-b7b0-5cabd234f6ce.jpg?v=1724641073
2026-05-29 21:44:41 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/deep-cleansing-clay-mask-415912_aeef579c-acfd-4bd6-92e4-6e78d71dacfb.jpg?v=1724641073
2026-05-29 21:44:41 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/deep-cleansing-clay-mask-144149_ec42c3b3-de2e-4195-9c28-9edfa4708525.jpg?v=1724641073
2026-05-29 21:44:41 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/crogooe-herbal-toner-765407_3a734e18-9a5b-4946-8cc4-d4fa5f5c332b.jpg?v=1724641075
2026-05-29 21:44:41 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-333200.jpg?v=1724641096
2026-05-29 21:44:42 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/crogooe-herbal-toner-810355_5fafe76e-941b-4616-abc5-d93deb4e611e.jpg?v=1724641075
2026-05-29 21:44:43 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/crogooe-herbal-toner-137816_7fd1af12-2d37-4305-8b79-cf6dfa88307f.jpg?v=1724641075
2026-05-29 21:44:43 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/crogooe-herbal-toner-432177_bfe967fa-a63c-4fd7-a30b-4d0d0c8cdf06.jpg?v=1724641075
2026-05-29 21:44:44 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/crogooe-herbal-toner-182703_49753601-9b53-4ff4-abb8-3916b687c5c3.jpg?v=1724641075
2026-05-29 21:44:46 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-317764.jpg?v=1724641096
2026-05-29 21:44:47 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/comfrey-herbal-balm-800661.jpg?v=1724640906
2026-05-29 21:44:47 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/coconut-sunshine-perfume-461129.jpg?v=1724640750
2026-05-29 21:44:47 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/coconut-oil-peppermint-ayurvedic-pulling-oil-set-with-tongue-scraper-497351.jpg?v=1724640749
2026-05-29 21:44:47 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/55d6f7d1-03a8-4c88-9f4e-6599018ddde7.jpg?v=1725683379
2026-05-29 21:44:47 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/5ff9be6d-cf20-474b-9ef6-2707b62b3cf4.jpg?v=1725683387
2026-05-29 21:44:48 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/cda13750-12f7-4105-b592-c6bb0183a459.jpg?v=1725683384
2026-05-29 21:44:48 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/c11a6629-f615-4db9-895e-e21ab13eb1e9.jpg?v=1725683382
2026-05-29 21:44:48 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-vitamin-c-serum-with-hyaluronic-acid-765105.jpg?v=1724640754
2026-05-29 21:44:49 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-skin-body-care-turmeric-facial-scrub-449137.jpg?v=1724640754
2026-05-29 21:44:50 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-skin-body-care-turmeric-facial-scrub-790833.jpg?v=1724640754
2026-05-29 21:44:50 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-skin-body-care-turmeric-facial-scrub-666963.jpg?v=1724640754
2026-05-29 21:44:51 [scrapy.extensions.logstats] INFO: Crawled 132 pages (at 102 pages/min), scraped 174 items (at 144 items/min)
2026-05-29 21:44:51 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-skin-body-care-turmeric-facial-scrub-684749.jpg?v=1724640754
2026-05-29 21:44:52 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/brightening-skin-body-care-turmeric-facial-scrub-684161.jpg?v=1724640754
2026-05-29 21:44:53 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/black-tea-rose-cleansing-gel-mask-342301.jpg?v=1724640755
2026-05-29 21:44:54 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/c85d96a5-b33c-4061-bee4-27eba1571875_trans.jpg?v=1725683322
2026-05-29 21:44:55 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/3ec54735-fee9-433e-a74f-886e05252cd0_trans.jpg?v=1725683312
2026-05-29 21:44:56 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/296a8a61-0e2d-4bbc-b5fb-5b983c5b3d3c_trans.jpg?v=1725683301
2026-05-29 21:44:56 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/a2e05b59-d774-4cb5-9f8f-efc85fc156ee_trans.jpg?v=1725683319
2026-05-29 21:44:57 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/7527c7ff-7644-4d7d-b39a-08d16739e9b1_trans.jpg?v=1725683298
2026-05-29 21:44:58 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/ec6ccb9c-a8c7-4ae9-97f5-fa74e88357f4_trans.jpg?v=1725683317
2026-05-29 21:44:59 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/b7eeff57-72ce-4981-9567-66f4591cb079_trans.jpg?v=1725683314
2026-05-29 21:45:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/c40ffbf9-73cf-4d94-9216-378498f04391_trans.jpg?v=1725683304
2026-05-29 21:45:01 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/ecf4abff-f1fd-4f3c-914a-f9e81f3d094b_trans.jpg?v=1725683309
2026-05-29 21:45:01 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/eec453ba-8964-433b-b836-1f8b58442474.jpg?v=1725683154
2026-05-29 21:45:02 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/5f262106-7df0-4c1b-8134-9503f01b2142.jpg?v=1725683453
2026-05-29 21:45:03 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/30895704-bf49-4179-b239-67418d1e9c4c.jpg?v=1725683481
2026-05-29 21:45:04 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/7570d7f0-5adb-4dad-901b-fba107f361dd.jpg?v=1725683478
2026-05-29 21:45:05 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/1a0fe156-f073-4594-a502-ecd57db6f0ec.jpg?v=1725683475
2026-05-29 21:45:05 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/fe429ae9-ee51-47f3-beda-39e2643d01df.jpg?v=1725683472
2026-05-29 21:45:06 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/286a780e-a4e4-4d85-b9a4-49ef09d7cbbc.jpg?v=1725683441
2026-05-29 21:45:07 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/5cc55704-d740-419c-b425-d397aeef903e.jpg?v=1725683469
2026-05-29 21:45:08 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/e8fcc783-4131-4297-86c0-62e77dcc5b63.jpg?v=1725683466
2026-05-29 21:45:08 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/b6f77309-4fd1-4297-8346-d3a62b34b94f.jpg?v=1725683463
2026-05-29 21:45:09 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/c053ac71-d043-41c5-bc90-795a56fa2ab0.jpg?v=1725683455
2026-05-29 21:45:10 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/20342930-99ed-4b0b-b3a7-86ee1bcf19b3.jpg?v=1725683432
2026-05-29 21:45:11 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0559/4097/2643/files/8f6f875c-9906-4f39-9c87-b88ffb1fdf23.jpg?v=1725683460
2026-05-29 21:45:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-05-29 21:45:11 [ImageSpider] INFO: RetrieverAPI is making requests to https://api.adretriever.com with headers {'Authorization': 'Token 96dfb640234f1d676d6fa726f8eae6e7aab44cda'}
2026-05-29 21:45:11 [root] INFO: Making post request to https://api.adretriever.com/api/validated_urls/e3324522
2026-05-29 21:45:12 [loknow_spiders] INFO: Cache hit rate: 21.83%
2026-05-29 21:45:12 [loknow_spiders] INFO: Cached images: c382d346b1fbba38a47_1779396160: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/FullSizeRender.heic?v=1741823078
e00737a07e224eadfa2_1779136740: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-340408.jpg?v=1724641080
68e8e9d6ad9f19ab00c_1777564372: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-103286.jpg?v=1724641080
fb465940c288f77f78a_1780004209: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-coconut-oil-aloe-lip-mask-843420.jpg?v=1724641072
e036508fa3aee3dfeca_1780004209: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-coconut-oil-aloe-lip-mask-753914.jpg?v=1724641072
f1a09b1f0b2b6e01f78_1778270176: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-coconut-oil-aloe-lip-mask-497616.jpg?v=1724641072
7df5fc26dfacb3b3f95_1779396194: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/rose-coconut-oil-aloe-lip-mask-745531.jpg?v=1724641072
d80989d5f375cacb2a3_1778963203: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-898124.jpg?v=1724641081
da2b258ed0da96ee417_1779396195: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-872168.jpg?v=1724641081
516ff97fc040b0a3cc8_1778270178: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-500007.jpg?v=1724641081
278bf4073e806f9e28b_1778876145: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/8833998F-9EA9-4416-B3AD-B19ADD3F2C89.png?v=1724979754
dfd67d25d19d996ba51_1778616499: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-879489.jpg?v=1724641081
4a597c2702298e6df4d_1778616499: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-330782.jpg?v=1724641081
5a28b4a5d2851a38d9f_1780004214: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/FullSizeRender_f1d89835-0909-4968-a4bd-2fecefc00204.jpg?v=1728333238
4dcac259c1cb177faa6_1778789713: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/FullSizeRender_fd586a7e-408c-402f-820e-d21046aab952.jpg?v=1728333238
fd39a58550ae16b95fb_1778876155: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/FullSizeRender_89e72777-13e6-47cb-8882-36101885cd8b.jpg?v=1724907762
4b54b93bbba286e18ba_1778616508: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/lavender-warm-winter-cotton-slippers-163937.jpg?v=1724640911
787ec722322791d50c3_1778616508: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/lavender-warm-winter-cotton-slippers-691917.jpg?v=1724640911
1d0587236d7d8a2ff95_1779916960: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/herbaluxe-hair-density-growth-balm-936025.jpg?v=1724640906
ad8579d9276664d9986_1779396201: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/eb50850e-6ef1-429b-8a4d-2ac13840ec1c.jpg?v=1731113721
1d86cb830ee86e0912b_1779396202: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/electric-gua-sha-541849.jpg?v=1724640912
65d9292aa0cde2ae69d_1777737211: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/electric-gua-sha-988560.jpg?v=1724640912
f70456fc26461cb1a51_1778270187: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/electric-gua-sha-432071.jpg?v=1724640912
a0b25e123a63ade56ee_1778270187: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/electric-gua-sha-616090.jpg?v=1724640912
08528985aa57983da09_1777564392: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-900865.jpg?v=1724641096
39b7a1250c899873a37_1779396203: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-638423.jpg?v=1724641096
6b5da1198a44c0837e9_1779396203: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-667940.jpg?v=1724641096
7b77d97a9d2aad61f37_1778876159: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-752916.jpg?v=1724641096
d974a7343cb6ceb5dc0_1777564397: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-231264.jpg?v=1724641096
d1058332857ac8f62d4_1779396204: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-478246.jpg?v=1724641096
d45bcf8e87b73b03b59_1778182870: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-264250.jpg?v=1724641095
9bb9d67eeef33055392_1779396205: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-152045.jpg?v=1724641096
0d511a051c4a73fd6cc_1778616515: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-748627.jpg?v=1724641095
68432131f083e9e078f_1779396205: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-131787.jpg?v=1724641096
1eeeadad48d4a91f1bf_1778876161: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-646891.jpg?v=1724641096
bdff8b932dd5457ed64_1777564400: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-459443.jpg?v=1724641096
77e3b7b581b6e6c94b3_1779396206: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-317596.jpg?v=1724641096
e671ba32e9331b33d64_1779396206: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-734938.jpg?v=1724641096
2a3be5d219be6efbf88_1778789723: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-808417.jpg?v=1724641096
0b956d9dc684e070863_1779396207: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-150156.jpg?v=1724641096
3821ec35be8e6ff7212_1778789724: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-422709.jpg?v=1724641096
ef6b5d60c35f520840d_1779396208: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-642833.jpg?v=1724641096
e8437a8053392243e98_1778789725: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-422396.jpg?v=1724641095
5fba93abf1c2ef6e674_1778182875: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/cosmic-third-eye-aromatherapy-stash-box-candle-holder-387516.jpg?v=1724640911
6ffb8f4a50850148ac9_1780004224: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/cosmic-third-eye-aromatherapy-stash-box-candle-holder-789187.jpg?v=1724640911
a56af00a58abfd2e799_1778876166: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/IMG-8612.png?v=1727658181
2026-05-29 21:45:12 [loknow_spiders] INFO: Uncached images: https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-763698.jpg?v=1724641080
https://cdn.shopify.com/s/files/1/0559/4097/2643/files/shower-steamers-aromatherapy-337054.jpg?v=1724641080
https://cdn.shopify.com/s/files/1/0559/4097/2643/files/pouring-teacup-ceramic-backflow-incense-burner-921748.jpg?v=1724641081
https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-317764.jpg?v=1724641096
https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-933331.jpg?v=1724641096
https://cdn.shopify.com/s/files/1/0559/4097/2643/files/dried-flower-fragrance-incense-candle-333200.jpg?v=1724641096
2026-05-29 21:45:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (284 items) in: file:///home/scrapyd/items/loknow_spiders_prod/ImageSpider/ed77a9605ba611f1bdc0c3bbae71ecef.jl
2026-05-29 21:45:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 48156,
'downloader/request_count': 157,
'downloader/request_method_count/GET': 3,
'downloader/request_method_count/HEAD': 154,
'downloader/response_bytes': 619874,
'downloader/response_count': 157,
'downloader/response_status_count/200': 55,
'downloader/response_status_count/404': 102,
'dupefilter/filtered': 130,
'elapsed_time_seconds': 261.13556,
'feedexport/success_count/FileFeedStorage': 1,
'file_count': 6,
'file_status_count/downloaded': 3,
'file_status_count/uptodate': 3,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 5, 29, 21, 45, 12, 225888),
'item_scraped_count': 284,
'log_count/INFO': 30,
'log_count/WARNING': 104,
'memusage/max': 160841728,
'memusage/startup': 133545984,
'response_received_count': 157,
'scheduler/dequeued': 154,
'scheduler/dequeued/memory': 154,
'scheduler/enqueued': 154,
'scheduler/enqueued/memory': 154,
'start_time': datetime.datetime(2026, 5, 29, 21, 40, 51, 90328)}
2026-05-29 21:45:12 [scrapy.core.engine] INFO: Spider closed (finished)
-
Log
/1/log/utf8/loknow_spiders_prod/ImageSpider/ed77a9605ba611f1bdc0c3bbae71ecef/?job_finished=True
-
Source
https://scrapyd.adretriever.com/logs/loknow_spiders_prod/ImageSpider/ed77a9605ba611f1bdc0c3bbae71ecef.log