Head
2026-05-30 06:07:43 [scrapy.utils.log] INFO: Scrapy 2.10.0 started (bot: retriever)
2026-05-30 06:07:43 [scrapy.utils.log] INFO: Versions: lxml 5.1.0.0, libxml2 2.12.3, cssselect 1.2.0, parsel 1.9.0, w3lib 2.0.0, Twisted 22.4.0, Python 3.10.12 (main, Mar 3 2026, 11:56:32) [GCC 11.4.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.5, Platform Linux-6.8.0-1030-aws-x86_64-with-glibc2.35
2026-05-30 06:07:43 [scrapy.addons] INFO: Enabled addons:
[]
2026-05-30 06:07:43 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
'BOT_NAME': 'retriever',
'HTTPCACHE_EXPIRATION_SECS': 86400,
'IMAGES_STORE_S3_ACL': 'public-read',
'LOG_FILE': '/home/scrapyd/logs/loknow_spiders_prod/ImageSpider/dd40ffa05bed11f1bdc0c3bbae71ecef.log',
'LOG_FORMATTER': 'loknow_spiders.logging.PoliteLogFormatter',
'LOG_LEVEL': 'INFO',
'NEWSPIDER_MODULE': 'loknow_spiders.spiders',
'SPIDER_MODULES': ['loknow_spiders.spiders'],
'TELNETCONSOLE_ENABLED': False,
'USER_AGENT': 'AdRetriever (https://adretriever.com)'}
2026-05-30 06:07:43 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/utils/request.py:248: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.
It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.
See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
return cls(crawler)
2026-05-30 06:07:43 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.throttle.AutoThrottle']
2026-05-30 06:07:43 [ImageSpider] INFO: Current Spider Environment set to: prod
2026-05-30 06:07:43 [ImageSpider] INFO: Retrieving AWS secret: spider_prod_secrets
2026-05-30 06:07:43 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-30 06:07:43 [ImageSpider] INFO: In base spider ml_kwargs is None and scrape_type is inventory
2026-05-30 06:07:43 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'loknow_spiders.middlewares.ThrottlingRetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-05-30 06:07:43 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'loknow_spiders.middlewares.RetrieverSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-05-30 06:07:44 [botocore.credentials] INFO: Found credentials in shared credentials file: ~/.aws/credentials
2026-05-30 06:07:44 [scrapy.middleware] INFO: Enabled item pipelines:
['loknow_spiders.pipelines.ImageUrlsValidationPipeline']
2026-05-30 06:07:44 [scrapy.core.engine] INFO: Spider opened
2026-05-30 06:07:44 [loknow_spiders] INFO: Scrape ID: 9d91c5e4
2026-05-30 06:07:44 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-05-30 06:07:49 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/1518e56e3fa5bfce.jpg?v=1773685582
2026-05-30 06:07:58 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/c766989165d5c676.jpg?v=1773685335
2026-05-30 06:07:58 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/8c8b39ebb0172730.jpg?v=1773685233
2026-05-30 06:07:59 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2c108306-e198-4898-8980-d412423833fb.jpg?v=1773672907
2026-05-30 06:07:59 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_108c3e19-9657-46a1-991e-4bf534254ed6.jpg?v=1773672907
2026-05-30 06:07:59 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_eb149717-2b5b-47ff-88c3-dbcb9500f708.jpg?v=1773673228
2026-05-30 06:08:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_ccc2357a-d7e7-4162-8d4e-9110842cb72f.jpg?v=1773673194
2026-05-30 06:08:00 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_8b0d2b24-d85e-4646-b1fb-83a0ce9e045f.jpg?v=1773673075
2026-05-30 06:08:03 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_72d688dc-c6c2-4588-abc5-4725309941fc.jpg?v=1773673319
2026-05-30 06:08:05 [py.warnings] WARNING: /home/scrapyd/venv/lib/python3.10/site-packages/scrapy/pipelines/images.py:154: ScrapyDeprecationWarning: ImageUrlsValidationPipeline.convert_image() method overridden in a deprecated way, overridden method does not accept response_body argument.
warnings.warn(
2026-05-30 06:08:05 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/5-Waterproof_Bag.webp?v=1770701973
2026-05-30 06:08:06 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2-Waterproof_Bag.webp?v=1770701974
2026-05-30 06:08:08 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_c72f9384-3ef5-4520-ba3c-63dcdb2f8e81.jpg?v=1773672872
2026-05-30 06:08:08 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a23a5f4b-a837-4b6b-a22a-0e679ff95559.jpg?v=1773672865
2026-05-30 06:08:12 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/9774442C-F20D-43F3-B042-0E9BB13E9911.jpg?v=1770575193
2026-05-30 06:08:13 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02A900C3-ED39-4D23-B527-7742EEBBC8CC.jpg?v=1770575194
2026-05-30 06:08:13 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/C0CB0330-8136-4EB7-8D3D-AB14E04D0778.jpg?v=1770575201
2026-05-30 06:08:18 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/yoga_amz1.jpg?v=1770563166
2026-05-30 06:08:18 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/c63ef682-1421-4c02-9f71-8d5286a86627.33c4fdbfae6f134053176a21d684dedb__32942.1655134086.1280.1280.jpg?v=1770702169
2026-05-30 06:08:19 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_0a605a4d-662d-49ca-837f-996578ec4d8e.jpg?v=1773673283
2026-05-30 06:08:19 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_189e4c3e-3f07-40c6-81fa-329036a41112.jpg?v=1773673332
2026-05-30 06:08:20 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_9f1a2bc9-72da-4e78-81d9-e9d6bfca2192.jpg?v=1773673291
2026-05-30 06:08:20 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a39c73d2-0c59-4097-a666-b99c4b924b16.jpg?v=1773673298
2026-05-30 06:08:21 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_89301359-f18a-4ca1-b6d6-ccbe92d77fcb.jpg?v=1773673324
2026-05-30 06:08:23 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_7c93a11c-e8b0-4691-b631-3bf6dd25f8f7.jpg?v=1773673374
2026-05-30 06:08:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_28cd22cb-1b14-4c98-bb20-4e1c7ebb1053.jpg?v=1773673186
2026-05-30 06:08:24 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_bdf2757a-7735-4d41-90c2-e8749382b8df.jpg?v=1773673307
2026-05-30 06:08:25 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/8_f50bdd25-04b3-4c87-b3f5-68502eec7bf8.png?v=1770575196
2026-05-30 06:08:25 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2_5c137307-a186-4340-821d-1f245d3f1e3d.png?v=1770575193
2026-05-30 06:08:26 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_d2e4e10f-867b-4eec-a8d2-9e34f2994cb5.jpg?v=1773673340
2026-05-30 06:08:34 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/IMG_1516.jpg?v=1770563155
2026-05-30 06:08:34 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/5_747defa5-6a7e-45bf-ab14-da2b2a30bfac.png?v=1770575194
2026-05-30 06:08:44 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 108 pages/min), scraped 108 items (at 108 items/min)
2026-05-30 06:08:44 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02-love-ellie-phone-pocket-black-1-66f41170b860f.webp?v=1770701926
2026-05-30 06:08:45 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_605d8f45-6185-434d-ac48-3a4e99428832.jpg?v=1773672817
2026-05-30 06:08:45 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02-Phone_Pocket-Blush.webp?v=1770701893
2026-05-30 06:08:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/manualProduct_2F0ad8596d770c5301113e98216b6f8fc9.png?v=1770563158
2026-05-30 06:08:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/manualProduct_2F42be6624ff8bac46952c92e6b887f345.png?v=1770563166
2026-05-30 06:08:46 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/manualProduct_2Fffb90c7a45c85fc5adce0f30b9e954ae.png?v=1770563163
2026-05-30 06:08:49 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/29621223-A3DA-4513-9E1D-748541D7004E.jpg?v=1770575193
2026-05-30 06:08:49 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_64fa5137-48c2-4e7a-824b-ad98296b7641.jpg?v=1773672965
2026-05-30 06:08:50 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard5_299dad56-7df6-4029-90fb-e67da060a437.webp?v=1770701958
2026-05-30 06:08:51 [loknow_spiders] INFO: Completed https://cdn.shopify.com/s/files/1/0804/0241/5834/files/ssw3gbxp5sanfzzjrcdr0iwx-large.png?v=1770701909
2026-05-30 06:08:54 [ImageSpider] WARNING: Failed to validate image: Image not accessible - https://cdn.shopify.com/s/files/1/0804/0241/5834/files/ChatGPT_Image_Mar_26_2025_02_47_41_PM.png?v=1770701805
Tail
2aa59b27db5035722a4_1778194484: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_4f4b2d2a-61ac-4064-9ead-48614ba606ac.jpg?v=1773672344
91c60d91d6f38a9b638_1779430144: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_f1582874-ca3b-4eeb-895d-cc72b9e4d59a.jpg?v=1773672343
5c7975891469726c5d7_1778628263: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_7b63f9c8-d2f0-4202-9ce3-ca9e9fc664d6.jpg?v=1773672563
f01053ff6870a2dc622_1778801628: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_6e00aa9c-7925-4cb7-9d37-190903d9fb6f.jpg?v=1773672562
944d4c83a2791a40fe9_1778194485: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_8e1afc89-77d9-4460-adac-7b67df3dd7b2.jpg?v=1773672457
da3149ea1ea1117f6a3_1780035077: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2cf95f48-7ad6-449f-ace5-32fc01d7ab9e.jpg?v=1773672456
ad1f9fc1639a8f00a45_1780035077: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/ammuri-hyperpigmentation-skincare-set-brightening-vitamin-c-products.jpg?v=1770703649
b485d78857255db43df_1777588787: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/revamp-anti-aging-skincare-for-30-plus-vitamin-face-mask.jpg?v=1770703646
50254950831c30f082d_1778194487: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/amunari-derma-roller-skincare-red-roller-40-titanium-needles.jpg?v=1770703677
59d233e42af21158df9_1780035077: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/amunari-derma-roller-skincare-purple-roller-40-titanium-needles.jpg?v=1770703677
17f33d19c3f3a812de6_1777761427: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/amethyst-quartz-foaming-bath-soak-hidden-surprise-bracelet-inside-422841.jpg?v=1770563155
a449559e2f478e2ef3c_1778888165: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/amethyst-quartz-foaming-bath-soak-hidden-surprise-bracelet-inside-782311.jpg?v=1770563156
9a08cb98af611788a6f_1777588790: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/amethyst-quartz-foaming-bath-soak-hidden-surprise-bracelet-inside-760631.jpg?v=1770563158
f0e3f37e4621742eba3_1779516506: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/American-Style-Mid-length-Curly-Wig-cashymart-35574445572374.jpg?v=1770701860
d5d8b014992b937f05d_1778280883: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_41a84f8a-25ef-4c6a-86d6-4433ccc48ba6.jpg?v=1773672259
cd636d01ac974ffbf8e_1778107607: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/BFM_ProductImages_2000x2000_SPM7_ActiveSham2025_01.jpg?v=1770701986
4625b274663c191537a_1779235117: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/BFM_ProductImages_2000x2000_SMP17_ActiveSham2025_01_ce7274dc-91d7-466a-967b-7c8e4095a5e9.jpg?v=1770701988
eac96b41a74b621aa0f_1777415875: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_5f94928f-cfc3-4b51-a502-2505df7a8f08.jpg?v=1773672781
a6699bcd2c2dfc038b2_1778801630: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_5d4a3154-39b8-4bc9-92d8-0a97a4dcbc6f.jpg?v=1773672780
537863e54627a8119d4_1779430146: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_320ec881-d0cf-4ab8-950b-779ccc23705e.jpg?v=1773672531
648bfa225843779fa99_1777761428: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a6829827-e492-440a-82ee-7391d4b5fe8a.jpg?v=1773672530
e6abaf72e547b917813_1778194489: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_cfb71b41-5ab8-4ac1-987a-00c3e76d8fc2.jpg?v=1773672529
cc58c354625a0118b48_1778194490: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_4868d728-6420-4057-80ac-e63649c8557a.jpg?v=1773672811
85a65e67f34cd5c9460_1779862167: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a19c335c-5df3-4066-8994-3049b1206917.jpg?v=1773672220
32f49628035e94ed3a1_1778888170: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_ea1e6811-2a91-47a0-ae7e-eaf8d511e8e6.jpg?v=1773672677
ecda70bed2f31795e47_1778628268: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_eacb6ed5-4f8c-4f69-b9a3-1965267cbefa.jpg?v=1773672515
5e6c2dd4ec290f329fa_1778194493: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2160ecd1-8746-484d-a57c-db1f438d439e.jpg?v=1773672726
d74edd0b116e8e711ed_1778888170: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_3cbbd92b-59bd-4336-bc12-fda3ac2ddbf8.jpg?v=1773672725
9b1eba786b3c9ea658f_1777588806: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_e8a0ae66-c35b-4adf-a327-59e3a387bd4f.jpg?v=1773672727
76358def7c68bfba1bf_1778194494: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2b3fefda-2827-4030-8ee8-b621a5b6132a.jpg?v=1773672690
28b669ea1078f98fb93_1779948579: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_1a225b93-adda-48fa-b36f-ce6a2bf6dbc2.jpg?v=1773672689
258aa4e7cdfdc08cb2a_1780035082: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_4e5d7a68-79a6-49cd-a8af-fa3a7b16028e.jpg?v=1773672207
10cdbf4fc61d9bcc9bf_1777761433: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_b697af29-ec4b-460f-ae28-f216c2982f0e.jpg?v=1773672204
747499b6715a523bd0f_1778714756: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_0b7c37a1-76f8-471f-b127-d02814c8f78f.jpg?v=1773672205
4193ce4daecdc464b09_1779516514: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_5c73c440-b55f-480d-a497-0587696c7d22.jpg?v=1773672175
c07f1d7898fb7aafd36_1779235124: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_08d3a7c5-becf-4869-a577-e1cc58266721.jpg?v=1773672174
90305a894500b1bf0f5_1778628271: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_ebaca3c1-c88a-489e-b7b0-21d4f60bc707.jpg?v=1773672176
77523bad05136fe8e0f_1779235125: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_0f1374cc-a68a-4897-bf14-e4aa84438da7.jpg?v=1773672784
718187fbb00df1df734_1779148122: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_01f69d14-3a5e-40b6-b35c-ad20c3e4c395.jpg?v=1773672849
6cf588d1c49b6ab7617_1779862171: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_543d320b-9111-49c0-9a0d-3bd252aa2c77.jpg?v=1773672848
453e361c4b50039969a_1780035084: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_24039af2-2866-4f36-b68f-3b6556e8b2eb.jpg?v=1773672848
20e724838c5b0f41674_1777588819: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_c07b9b96-ae6f-4d6c-ad44-d6a221789f18.jpg?v=1773672334
055c84534698c6f26b5_1778541237: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_95b0282e-7357-4b6f-81c9-4b4b355ed372.jpg?v=1773672334
1dfca32f0394aa9dbe5_1779516515: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_4d128e6e-6b66-426a-995a-9b241b66eb63.jpg?v=1773672670
0502d76e7469822c8f5_1778194500: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/01-Screen_Protector-14_Pro_Max.webp?v=1770702045
6805ae68c478ddb35ca_1779430154: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_de489444-b470-4280-9a77-6a321f83b166.jpg?v=1773672982
7b1cb59aa75acab4607_1778194500: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a1bbd9ad-b249-4fe6-93cb-58dca65934e5.jpg?v=1773672285
6de82a6f5497bacfc8d_1778628274: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a79a6800-aa4a-463f-bced-f990812ab7e2.jpg?v=1773672658
5befe14d3231504b548_1779430156: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_555a7451-daa7-4121-8365-5bdb096581b5.jpg?v=1773672580
77a5dd0019500cf7e1a_1780035087: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/glycolic_toner_2.jpg?v=1770563378
ef4192b1263fc1f261e_1779235128: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/glycolic_toner_wht3.jpg?v=1770563379
c765646b3c65ca9438b_1778194503: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/glycolic_toner_7.png?v=1770563379
b6abf0ffd64ae97d261_1779430156: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/glycolicfb_73fb9f86-5fca-4add-8ddb-a5c0e787d0ba.jpg?v=1770563380
75d074c384c18967cd6_1777415886: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/renew_12_glycolic_amz3_3d0dbb68-7dd4-41bd-a936-256eafa1718e.jpg?v=1770563380
598526c8750f45e57de_1777676149: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_63d2832c-e309-4077-a35c-c60f5f836b3e.jpg?v=1773672463
eef11ea4ad2d4619225_1778107618: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2e9d2d10-c84c-4d88-b3c3-3283eb399e56.jpg?v=1773672779
15595e4d103c8220be4_1777588843: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_d0f538ee-577d-41ed-8dd0-d529c96f0b5a.jpg?v=1773672243
00c3347d4e3ba916e06_1778888175: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_d790a443-b959-41a9-adc7-4ab3716c7226.jpg?v=1773672437
a5104c2b8ffbe1999ea_1779430158: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_6081e26c-9552-4404-a5af-0401cd08fafa.jpg?v=1773672365
dced7729cf93e5234ed_1777676152: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_5a1ae316-0158-4aee-ba02-476df03f27de.jpg?v=1773672741
f05e7f61094abdc7330_1778714763: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_73ff40c1-07ed-4231-972e-9c7710d9ed4d.jpg?v=1773672740
385929274d83f5956c9_1778801644: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_29aca07d-98ae-4ec4-8417-8c24357170d3.jpg?v=1773672650
3845cdac38038666968_1777588848: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/reusable-cotton-rounds-white-8-2hook-thumbnail-plantish-future.jpg?v=1770701807
30b3a943bad23175317_1779430160: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/reusable-cotton-rounds-white-4-hook-thumbnail-plantish-future_7371f8f9-437e-45ef-8a8c-3bba11d8d176.jpg?v=1770701808
ab7f1b7e843332728b4_1780035090: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/makeup-remover-pads-plantish-future.jpg?v=1770701807
197c64d40da43b34b8e_1778888177: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/cotton-face-rounds-plantish-future.jpg?v=1770701808
16cc9e395a54044075e_1779948587: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/reusable-cotton-rounds-white-16-thumbnail-plantish-future.png?v=1770701809
aa59441e23e9ae3e07c_1778801649: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_5a0b58e0-0da1-43a9-97ab-1b95c9fa2e7a.jpg?v=1773672854
204eeacdfd0ea819b02_1778107620: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_1c640507-ce4b-4a5a-8ddc-cb8198722ae5.jpg?v=1773672256
49549d72b6afec08f74_1779430161: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2d527c57-57fc-45f1-811a-8c03b9c2965d.jpg?v=1773672140
1a19d3e6d26e647132a_1780035092: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_12e29789-e22e-458d-9c8f-a1a8c82d01e6.jpg?v=1773672141
2026-05-30 06:12:02 [loknow_spiders] INFO: Uncached images: https://cdn.shopify.com/s/files/1/0804/0241/5834/files/download_4_af100385-e4b4-4089-b4b1-77133da94a90.png?v=1770702170
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/renew_12_glycolic_amz.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/lunasetwhtamz1.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-75.jpg?v=1770575195
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard4_4f4532e5-3641-4035-baca-200243a43639.webp?v=1770701907
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-26_4cdddf2d-a9ab-445c-be27-5bd91ddb4e7b.jpg?v=1770575196
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/5_747defa5-6a7e-45bf-ab14-da2b2a30bfac.png?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard1_ac482876-fe57-482d-84aa-3a0214210d62.webp?v=1770701914
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-2copy.jpg?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard5_299dad56-7df6-4029-90fb-e67da060a437.webp?v=1770701958
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard3_30b5c874-cb6f-48bc-aa19-50e69b689e43.webp?v=1770702794
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/dryer-plus-spotlight-or-1_2048x2048_f098007d-45ac-40fa-93b3-af8de5ea29fd.jpg?v=1770702307
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/dovallssocial_4_1.jpg?v=1770701830
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Signature-10OFTASKS-Image6.jpg?v=1770702108
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/E69F6BC0-F9FB-4D7B-842D-FE67DAD04E07.jpg?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_7973c60b-9d28-4d5e-9bc3-ca7f1f684584.jpg?v=1773672267
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_d19110b5-9484-47ce-affe-9e4603a0cfb3.jpg?v=1773672804
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_9900db42-40b3-4510-8ff7-916e98d1f604.jpg?v=1773672256
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard2_4994a591-0b70-4faf-92e8-65d2d1361e29.webp?v=1770701990
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/AFH-011-MIGHTY_MINI-TRAVEL-DRYER-PH-PACKAGING-OR-02-APR-12-22.jpg?v=1770702308
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/DOUVALLS_LIP2_02.frenchNjpg.jpg?v=1770703659
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Curl_Steam_2048.png?v=1770701842
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_f075a639-5968-44f0-8a76-f5a6f4dfa2ac.jpg?v=1773672234
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/DOVALLSSOCIAL_8.jpg?v=1770701830
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_fa2a2103-991a-45b7-8763-7712eb17523e.jpg?v=1773672388
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/EXTRAPOTENTALOPECIA-17_18e37e9f-22fe-44ef-a917-a9df1624342b.png?v=1770702499
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/b25e45f9-d9cb-4b32-8c77-3cd522786299.9d337b7e14f5326a4d6d6f774e310d2d__68195.1655396308.1280.1280.jpg?v=1770702252
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_c72f9384-3ef5-4520-ba3c-63dcdb2f8e81.jpg?v=1773672872
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/C0CB0330-8136-4EB7-8D3D-AB14E04D0778.jpg?v=1770575201
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_8c42dbfd-6331-4e9c-8770-fe5f0a6e395d.jpg?v=1773672152
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/yoga_amz1.jpg?v=1770563166
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Rif_Care_hemp_fiber_period_pads_organic_clean_pads_regular_absorbency.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Eucalyptus_shea_-_cbd.png?v=1770703597
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02A900C3-ED39-4D23-B527-7742EEBBC8CC.jpg?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Signature-10OFTASKS-Image5.jpg?v=1770702107
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/5-Waterproof_Bag.webp?v=1770701973
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/AFB-025-CALIFORNIA-2-PACK-BLEMISH-EXTRACTOR-PROD-COMPOSITE-CG-PI-NOV-25-22_1_1a2f38e8-00a2-4c23-b248-18f3892b0a37.png?v=1770702116
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Render_Mockup_1920_1920_2024-10-31_10_2.jpg?v=1770575193
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/VoiceoftheWomb_ProductShoot_EDP-16.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/il_fullxfull.3954982218_a7pf_3e24cbb9-9004-4e4e-9d87-f4edb0545a08.jpg?v=1770701959
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_2bf28f3e-a3f7-4290-aa35-765ef0f09f29.jpg?v=1773672690
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/c63ef682-1421-4c02-9f71-8d5286a86627.33c4fdbfae6f134053176a21d684dedb__32942.1655134086.1280.1280.jpg?v=1770702169
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/8_f50bdd25-04b3-4c87-b3f5-68502eec7bf8.png?v=1770575196
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02-Phone_Pocket-Blush.webp?v=1770701893
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/mime-attachment-2_1.jpg?v=1770703665
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_0aff8850-f0f1-4ed3-8a41-ca40d11f737f.jpg?v=1773672323
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2024_AMNH_Lollipops-89.jpg?v=1770575193
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/gugo_bar_6.jpg?v=1770563156
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/hemp-hydrating-shampoo-bar-cold-process-995721.jpg?v=1770563379
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_00b9e8af-27f5-4726-8af2-9ee6ab992335.jpg?v=1773672579
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/AFH-011-MIGHTY_MINI-TRAVEL-DRYER-PH-PACKAGING-RD-01-APR-12-22.jpg?v=1770702395
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/29621223-A3DA-4513-9E1D-748541D7004E.jpg?v=1770575193
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Mouse.jpg?v=1770701740
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Ingredient_Benefits_5516c3c4-3e26-474d-ad71-b1d87c14f7c4.png?v=1770702368
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Lavender-moisturizing-body-oil-lizush_3.jpg?v=1770703599
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Screenshot_2024-09-09_at_18.43.59.png?v=1770701883
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_15447d23-9e16-4dea-a40a-712493864fc8.jpg?v=1773672531
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/CHANDO-Whitening-Moisturising-SkinCare-Set-cashymart-39575807983894.webp?v=1770703657
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/ssw3gbxp5sanfzzjrcdr0iwx-large.png?v=1770701909
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-79.jpg?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_eb111d47-981b-427f-a476-86aaae02cc83.jpg?v=1773672761
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/XMASSET3.png?v=1770703671
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Product-101_copy_3_1113c999-2b9e-42c7-880a-79f3f6e7522f.jpg?v=1770703604
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/XMAS_SET_1.png?v=1770703566
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_a23a5f4b-a837-4b6b-a22a-0e679ff95559.jpg?v=1773672865
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-28_1_copy.jpg?v=1770575200
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/02-love-ellie-phone-pocket-black-1-66f41170b860f.webp?v=1770701926
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/6c170a1e-e214-473d-b4d6-5c33cb08ba7c_1.8400b8bac851315e6b3877125f77a0c6__98795.1655198125.1280.1280.jpg?v=1770702378
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_605d8f45-6185-434d-ac48-3a4e99428832.jpg?v=1773672817
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_ee94af63-bb6f-464c-8ad1-ed2a3405f037.jpg?v=1773672771
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_0aeb2abe-def5-4a87-8a1b-32cf76941b5d.jpg?v=1773672204
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2024AMNHSoap_MassageCandle-43.jpg?v=1770575203
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/MainImage_51ed8a37-9657-42c9-abd6-8419184906ab.webp?v=1770701985
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/4kcqoqj1svkian1zfwrul10q-large.png?v=1770702370
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/CHANDO-Whitening-Moisturising-SkinCare-Set-cashymart-39575807951126.webp?v=1770703657
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Lavender_scrub_small_-_cbd.png?v=1770703589
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/curly-hair-bundles-933985.jpg?v=1770701778
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/CHILDRENSARGANOIL_B.jpg?v=1770701813
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Puresheabutterfootcream-lizush.jpg?v=1770703595
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/9774442C-F20D-43F3-B042-0E9BB13E9911.jpg?v=1770575193
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard1_70e3e478-2db3-418e-94f3-022bbf0cabb7.webp?v=1770701913
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/MainImage_1a3bc628-11aa-4a66-9d13-4b391bba214c.webp?v=1770701914
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Artboard3_260d1ee1-8a57-41ae-8d4e-357be78a6750.webp?v=1770701989
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/sea-quartz-foaming-bath-soak-hidden-surprise-bracelet-inside-605844.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/DAMANCI_Hydrating_Shampoo_Conditioner_Duo_2.3oz.webp?v=1770701938
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2-Waterproof_Bag.webp?v=1770701974
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Siteproductpics_1500x1500px.png?v=1770702368
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2023AMNHFIneapples-9.jpg?v=1770575194
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_cfe0118e-db52-4382-a136-3ba64b08f392.jpg?v=1773672257
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/IMG_1516.jpg?v=1770563155
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Untitled_design_46__44860.1605497932.1280.1280.png?v=1770573390
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/duo_hair_serum.png?v=1770701982
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/xmastreecandle3.png?v=1770563380
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/2_5c137307-a186-4340-821d-1f245d3f1e3d.png?v=1770575193
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/05_3d9c07cc-0ad6-4ede-9843-36adb953b3bd.png?v=1770702369
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/saltedcaramel.png?v=1770702500
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/nourishing-conditioner-with-avocado-extract-110926.jpg?v=1770702168
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/Paavani-1659_websize.jpg?v=1770703604
https://cdn.shopify.com/s/files/1/0804/0241/5834/files/LB_ecd251ae-b0e4-4b87-b8d8-2e393417776f.jpg?v=1773672804
2026-05-30 06:12:02 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (914 items) in: file:///home/scrapyd/items/loknow_spiders_prod/ImageSpider/dd40ffa05bed11f1bdc0c3bbae71ecef.jl
2026-05-30 06:12:02 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 271102,
'downloader/request_count': 886,
'downloader/request_method_count/GET': 86,
'downloader/request_method_count/HEAD': 800,
'downloader/response_bytes': 58035154,
'downloader/response_count': 886,
'downloader/response_status_count/200': 758,
'downloader/response_status_count/404': 128,
'dupefilter/filtered': 114,
'elapsed_time_seconds': 258.510765,
'feedexport/success_count/FileFeedStorage': 1,
'file_count': 99,
'file_status_count/downloaded': 86,
'file_status_count/uptodate': 13,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 5, 30, 6, 12, 2, 883356),
'item_scraped_count': 914,
'log_count/INFO': 130,
'log_count/WARNING': 142,
'memusage/max': 312811520,
'memusage/startup': 135016448,
'response_received_count': 886,
'scheduler/dequeued': 800,
'scheduler/dequeued/memory': 800,
'scheduler/enqueued': 800,
'scheduler/enqueued/memory': 800,
'start_time': datetime.datetime(2026, 5, 30, 6, 7, 44, 372591)}
2026-05-30 06:12:02 [scrapy.core.engine] INFO: Spider closed (finished)