2025-08-31 17:19:58 [scrapy.utils.log] INFO: Scrapy 2.11.1 started (bot: singlebank)
2025-08-31 17:19:58 [scrapy.utils.log] INFO: Versions: lxml 6.0.1.0, libxml2 2.14.5, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 25.5.0, Python 3.12.3 (main, Apr  9 2024, 08:09:14) [Clang 15.0.0 (clang-1500.3.9.4)], pyOpenSSL 25.1.0 (OpenSSL 3.5.2 5 Aug 2025), cryptography 45.0.6, Platform macOS-15.6.1-arm64-arm-64bit
2025-08-31 17:19:58 [scrapy.addons] INFO: Enabled addons:
[]
2025-08-31 17:19:58 [asyncio] DEBUG: Using selector: KqueueSelector
2025-08-31 17:19:58 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-08-31 17:19:58 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-08-31 17:19:58 [scrapy.extensions.telnet] INFO: Telnet Password: 00c11558a1798e86
2025-08-31 17:19:58 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats']
2025-08-31 17:19:58 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'singlebank',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'CONCURRENT_REQUESTS_PER_DOMAIN': 4,
 'COOKIES_ENABLED': False,
 'DOWNLOAD_DELAY': 2,
 'DOWNLOAD_TIMEOUT': 30,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': 'multibank_log.txt',
 'LOG_STDOUT': True,
 'NEWSPIDER_MODULE': 'singlebank.spiders',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['singlebank.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2025-08-31 17:19:58 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-08-31 17:19:58 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-08-31 17:19:58 [scrapy.middleware] INFO: Enabled item pipelines:
['singlebank.custom_files_pipeline.CustomFilesPipeline']
2025-08-31 17:19:58 [scrapy.core.engine] INFO: Spider opened
2025-08-31 17:19:58 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-08-31 17:19:58 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-08-31 17:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): publicsuffix.org:443
2025-08-31 17:19:58 [urllib3.connectionpool] DEBUG: https://publicsuffix.org:443 "GET /list/public_suffix_list.dat HTTP/1.1" 200 87958
2025-08-31 17:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://thread.bank/> (referer: None)
2025-08-31 17:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/> (referer: None)
2025-08-31 17:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.snb-t.com/> (referer: None)
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): thread.bank:443
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: https://thread.bank:443 "HEAD /privacy-policy/ HTTP/1.1" 403 0
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "HEAD /hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf HTTP/1.1" 200 0
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "GET /hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf HTTP/1.1" 200 159863
2025-08-31 17:19:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://thread.bank/>
{'ID': '1149', 'privacy_link_from_landing_page': ['https://21857472.fs1.hubspotusercontent-na1.net/hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf', 'https://thread.bank/privacy-policy'], 'depth_0_pdf_links': ['https://21857472.fs1.hubspotusercontent-na1.net/hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf'], 'depth_0_html_links': ['https://thread.bank/privacy-policy'], 'files': []}
2025-08-31 17:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.independentbank.com/> (referer: None)
2025-08-31 17:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkbank.com/> (referer: None)
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:19:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://nebat.com/>
{'ID': '370', 'privacy_link_from_landing_page': ['https://nebat.com/privacy-notice.html'], 'depth_0_pdf_links': [], 'depth_0_html_links': ['https://nebat.com/privacy-notice.html'], 'files': []}
2025-08-31 17:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:01 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /privacy/ HTTP/1.1" 200 0
2025-08-31 17:20:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.snb-t.com/>
{'ID': '817', 'privacy_link_from_landing_page': ['https://www.snb-t.com/privacy'], 'depth_0_pdf_links': [], 'depth_0_html_links': ['https://www.snb-t.com/privacy'], 'files': []}
2025-08-31 17:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /privacy HTTP/1.1" 200 0
2025-08-31 17:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.independentbank.com/>
{'ID': '230', 'privacy_link_from_landing_page': ['https://www.independentbank.com/privacy'], 'depth_0_pdf_links': [], 'depth_0_html_links': ['https://www.independentbank.com/privacy'], 'files': []}
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /privacy-policy HTTP/1.1" 200 0
2025-08-31 17:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.linkbank.com/>
{'ID': '384', 'privacy_link_from_landing_page': ['https://www.linkbank.com/privacy-policy'], 'depth_0_pdf_links': [], 'depth_0_html_links': ['https://www.linkbank.com/privacy-policy'], 'files': []}
2025-08-31 17:20:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://thread.bank/privacy-policy/> from <GET https://thread.bank/privacy-policy>
2025-08-31 17:20:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://www.snb-t.com/privacy/> from <GET https://www.snb-t.com/privacy>
2025-08-31 17:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/privacy-notice.html> (referer: https://nebat.com/)
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /holiday-closing.html HTTP/1.1" 200 0
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /regular-savings.html HTTP/1.1" 200 0
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /disclosures.html HTTP/1.1" 200 0
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/privacypolicynebat.pdf HTTP/1.1" 200 0
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:02 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/privacypolicynebat.pdf HTTP/1.1" 200 167722
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice-mobile.html HTTP/1.1" 200 0
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /accessibility-statement.html HTTP/1.1" 200 0
2025-08-31 17:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://nebat.com/privacy-notice.html>
{'ID': '370', 'depth_1_html_saved': 'https://nebat.com/privacy-notice.html', 'depth_1_pdf_links': ['https://nebat.com/sft1798/privacypolicynebat.pdf'], 'depth_1_html_links': ['https://nebat.com/disclosures.html', 'https://nebat.com/accessibility-statement.html', 'https://nebat.com/holiday-closing.html', 'https://nebat.com/regular-savings.html', 'https://nebat.com/privacy-notice-mobile.html'], 'files': []}
2025-08-31 17:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.independentbank.com/privacy> (referer: https://www.independentbank.com/)
2025-08-31 17:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkbank.com/privacy-policy> (referer: https://www.linkbank.com/)
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /legal-notices HTTP/1.1" 200 0
2025-08-31 17:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024%20Independent%20Bank%20Annual%20Report.pdf HTTP/1.1" 200 0
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/2024%20Independent%20Bank%20Annual%20Report.pdf HTTP/1.1" 200 10319872
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024_CommunityImpactReport.pdf HTTP/1.1" 200 0
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/2024_CommunityImpactReport.pdf HTTP/1.1" 200 4415959
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/PrivacyPolicy.pdf HTTP/1.1" 200 0
2025-08-31 17:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/PrivacyPolicy.pdf HTTP/1.1" 200 130814
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/IBOnlinePrivacy%26SecurityPolicy.pdf HTTP/1.1" 200 0
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/IBOnlinePrivacy%26SecurityPolicy.pdf HTTP/1.1" 200 1400906
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /accessibility-statement HTTP/1.1" 200 0
2025-08-31 17:20:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.independentbank.com/privacy>
{'ID': '230', 'depth_1_html_saved': 'https://www.independentbank.com/privacy', 'depth_1_pdf_links': ['https://www.independentbank.com/hubfs/2024_CommunityImpactReport.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/IBOnlinePrivacy%26SecurityPolicy.pdf', 'https://www.independentbank.com/hubfs/2024%20Independent%20Bank%20Annual%20Report.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/PrivacyPolicy.pdf'], 'depth_1_html_links': ['https://www.independentbank.com/legal-notices', 'https://www.independentbank.com/accessibility-statement'], 'files': []}
2025-08-31 17:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /estatements HTTP/1.1" 200 0
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /disclosures HTTP/1.1" 200 0
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /accessibility-feedback HTTP/1.1" 200 0
2025-08-31 17:20:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.linkbank.com/privacy-policy>
{'ID': '384', 'depth_1_html_saved': 'https://www.linkbank.com/privacy-policy', 'depth_1_pdf_links': [], 'depth_1_html_links': ['https://www.linkbank.com/estatements', 'https://www.linkbank.com/disclosures', 'https://www.linkbank.com/accessibility-feedback'], 'files': []}
2025-08-31 17:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/privacy-notice-mobile.html> (referer: https://nebat.com/privacy-notice.html)
2025-08-31 17:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://thread.bank/privacy-policy/> (referer: https://thread.bank/)
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /holiday-closing.html HTTP/1.1" 200 0
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /regular-savings.html HTTP/1.1" 200 0
2025-08-31 17:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /disclosures.html HTTP/1.1" 200 0
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /accessibility-statement.html HTTP/1.1" 200 0
2025-08-31 17:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkbank.com/accessibility-feedback> (referer: https://www.linkbank.com/privacy-policy)
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "HEAD /hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf HTTP/1.1" 200 0
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): assets.tina.io:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://assets.tina.io:443 "HEAD /854745ed-f244-4a0d-bfa0-321425fdc744/Thread%20Bank%20Rate%20Sheet%20(2).pdf HTTP/1.1" 200 0
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): assets.tina.io:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://assets.tina.io:443 "GET /854745ed-f244-4a0d-bfa0-321425fdc744/Thread%20Bank%20Rate%20Sheet%20(2).pdf HTTP/1.1" 200 None
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): thread.bank:443
2025-08-31 17:20:07 [urllib3.connectionpool] DEBUG: https://thread.bank:443 "HEAD /sweep-disclosure/ HTTP/1.1" 403 0
2025-08-31 17:20:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://thread.bank/privacy-policy/>
{'ID': '1149', 'depth_1_html_saved': 'https://thread.bank/privacy-policy/', 'depth_1_pdf_links': ['https://assets.tina.io/854745ed-f244-4a0d-bfa0-321425fdc744/Thread%20Bank%20Rate%20Sheet%20(2).pdf'], 'depth_1_html_links': ['https://thread.bank/sweep-disclosure'], 'files': []}
2025-08-31 17:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:08 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /estatements HTTP/1.1" 200 0
2025-08-31 17:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:08 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /privacy-policy HTTP/1.1" 200 0
2025-08-31 17:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:09 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /disclosures HTTP/1.1" 200 0
2025-08-31 17:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.snb-t.com/privacy/> (referer: https://www.snb-t.com/)
2025-08-31 17:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/regular-savings.html> (referer: https://nebat.com/privacy-notice.html)
2025-08-31 17:20:09 [scrapy.linkextractors.lxmlhtml] DEBUG: Skipping extraction of link with bad URL 'http://tel:1-866-482-0404'
2025-08-31 17:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /tools-services/forms-disclosures/ HTTP/1.1" 200 0
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2024/03/SNB-Personal-Loan-Application-Fillable-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2024/03/SNB-Personal-Loan-Application-Fillable-rev.pdf HTTP/1.1" 200 None
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Mortgage-Application.pdf HTTP/1.1" 200 0
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:11 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/Mortgage-Application.pdf HTTP/1.1" 200 None
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Automatic-Withdrawal-Change-Form-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/Automatic-Withdrawal-Change-Form-rev.pdf HTTP/1.1" 200 42327
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Direct-Deposit-Change-Form-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/Direct-Deposit-Change-Form-rev.pdf HTTP/1.1" 200 29891
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Bid-Slip-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/Bid-Slip-rev.pdf HTTP/1.1" 200 26774
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Change-of-Address-Request_rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/Change-of-Address-Request_rev.pdf HTTP/1.1" 200 None
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/2021-SNB-Privacy-Notice.pdf HTTP/1.1" 200 0
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:13 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/02/2021-SNB-Privacy-Notice.pdf HTTP/1.1" 200 None
2025-08-31 17:20:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.snb-t.com/privacy/>
{'ID': '817', 'depth_1_html_saved': 'https://www.snb-t.com/privacy/', 'depth_1_pdf_links': ['https://www.snb-t.com/wp-content/uploads/2024/03/SNB-Personal-Loan-Application-Fillable-rev.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/Automatic-Withdrawal-Change-Form-rev.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/Mortgage-Application.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/2021-SNB-Privacy-Notice.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/Direct-Deposit-Change-Form-rev.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/Change-of-Address-Request_rev.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/02/Bid-Slip-rev.pdf'], 'depth_1_html_links': ['https://www.snb-t.com/tools-services/forms-disclosures'], 'files': []}
2025-08-31 17:20:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://thread.bank/sweep-disclosure/> from <GET https://thread.bank/sweep-disclosure>
2025-08-31 17:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.independentbank.com/accessibility-statement> (referer: https://www.independentbank.com/privacy)
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /holiday-closing.html HTTP/1.1" 200 0
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /disclosures.html HTTP/1.1" 200 0
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /accessibility-statement.html HTTP/1.1" 200 0
2025-08-31 17:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/holiday-closing.html> (referer: https://nebat.com/privacy-notice.html)
2025-08-31 17:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://thread.bank/sweep-disclosure/> (referer: https://thread.bank/privacy-policy/)
2025-08-31 17:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkbank.com/disclosures> (referer: https://www.linkbank.com/privacy-policy)
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /legal-notices HTTP/1.1" 200 0
2025-08-31 17:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /privacy HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024%20Independent%20Bank%20Annual%20Report.pdf HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024_CommunityImpactReport.pdf HTTP/1.1" 200 0
2025-08-31 17:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.independentbank.com/legal-notices> (referer: https://www.independentbank.com/privacy)
2025-08-31 17:20:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://www.snb-t.com/tools-services/forms-disclosures/> from <GET https://www.snb-t.com/tools-services/forms-disclosures>
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /regular-savings.html HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /disclosures.html HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /accessibility-statement.html HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "HEAD /hubfs/21857472/Thread%20Bank%20Disclosures%20-%20Corp%20site%20-%203M%20(1).pdf HTTP/1.1" 200 0
2025-08-31 17:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "GET /hubfs/21857472/Thread%20Bank%20Disclosures%20-%20Corp%20site%20-%203M%20(1).pdf HTTP/1.1" 200 207896
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): thread.bank:443
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: https://thread.bank:443 "HEAD /privacy-policy/ HTTP/1.1" 403 0
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): 21857472.fs1.hubspotusercontent-na1.net:443
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: https://21857472.fs1.hubspotusercontent-na1.net:443 "HEAD /hubfs/21857472/CCPA%20Privacy%20Notice%204.2024.pdf HTTP/1.1" 200 0
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): assets.tina.io:443
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: https://assets.tina.io:443 "HEAD /854745ed-f244-4a0d-bfa0-321425fdc744/Thread%20Bank%20Rate%20Sheet%20(2).pdf HTTP/1.1" 200 0
2025-08-31 17:20:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://thread.bank/sweep-disclosure/>
{'ID': '1149', 'depth_2_html_saved': 'https://thread.bank/sweep-disclosure/', 'depth_2_pdf_links': ['https://21857472.fs1.hubspotusercontent-na1.net/hubfs/21857472/Thread%20Bank%20Disclosures%20-%20Corp%20site%20-%203M%20(1).pdf'], 'depth_2_html_links': [], 'files': []}
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /estatements HTTP/1.1" 200 0
2025-08-31 17:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /assets/files/AofEk4fZ HTTP/1.1" 200 0
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "GET /assets/files/AofEk4fZ HTTP/1.1" 200 None
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /privacy-policy HTTP/1.1" 200 0
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /accessibility-feedback HTTP/1.1" 200 0
2025-08-31 17:20:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.linkbank.com/disclosures>
{'ID': '384', 'depth_2_html_saved': 'https://www.linkbank.com/disclosures', 'depth_2_pdf_links': ['https://www.linkbank.com/assets/files/AofEk4fZ'], 'depth_2_html_links': [], 'files': []}
2025-08-31 17:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /privacy HTTP/1.1" 200 0
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024%20Independent%20Bank%20Annual%20Report.pdf HTTP/1.1" 200 0
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/2024_CommunityImpactReport.pdf HTTP/1.1" 200 0
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Business%20Fee%20Schedule.pdf HTTP/1.1" 200 0
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Business%20Fee%20Schedule.pdf HTTP/1.1" 200 105773
2025-08-31 17:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/BusinessFeeSchedule.pdf HTTP/1.1" 404 0
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/RetailFeeSchedule0224.pdf HTTP/1.1" 200 0
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/RetailFeeSchedule0224.pdf HTTP/1.1" 200 109881
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/640MI_MV2021-02.pdf HTTP/1.1" 200 0
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/640MI_MV2021-02.pdf HTTP/1.1" 200 211005
2025-08-31 17:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/DP_ODP_Disclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/DP_ODP_Disclosure.pdf HTTP/1.1" 200 369423
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/OverdraftPrivilegeDisclosure.pdf HTTP/1.1" 404 0
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/ExtendedCoverageConsentForm.pdf HTTP/1.1" 200 0
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/ExtendedCoverageConsentForm.pdf HTTP/1.1" 200 531221
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/FundsAvailabilityNotice.pdf HTTP/1.1" 200 0
2025-08-31 17:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/FundsAvailabilityNotice.pdf HTTP/1.1" 200 94397
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/substitute_check_policy_2016.pdf HTTP/1.1" 200 0
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/substitute_check_policy_2016.pdf HTTP/1.1" 200 591911
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cdn2.hubspot.net:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://cdn2.hubspot.net:443 "HEAD /hubfs/452859/Website_Files/PDF/Mortgage_Fee_Schedule.pdf?t=1467769363888 HTTP/1.1" 200 0
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cdn2.hubspot.net:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://cdn2.hubspot.net:443 "GET /hubfs/452859/Website_Files/PDF/Mortgage_Fee_Schedule.pdf?t=1467769363888 HTTP/1.1" 200 87406
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/EFT_Agreement_Disclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/EFT_Agreement_Disclosure.pdf HTTP/1.1" 200 5052420
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/OnlineEsignDisclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/OnlineEsignDisclosure.pdf HTTP/1.1" 200 154894
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/Online_ElectronicBankingAgreement.pdf HTTP/1.1" 200 0
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "GET /hubfs/Website_Files/PDF/Online_ElectronicBankingAgreement.pdf HTTP/1.1" 200 397073
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /hubfs/Website_Files/PDF/PrivacyPolicy.pdf HTTP/1.1" 200 0
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.independentbank.com:443
2025-08-31 17:20:22 [urllib3.connectionpool] DEBUG: https://www.independentbank.com:443 "HEAD /accessibility-statement HTTP/1.1" 200 0
2025-08-31 17:20:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.independentbank.com/legal-notices>
{'ID': '230', 'depth_2_html_saved': 'https://www.independentbank.com/legal-notices', 'depth_2_pdf_links': ['https://www.independentbank.com/hubfs/Website_Files/PDF/EFT_Agreement_Disclosure.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/OnlineEsignDisclosure.pdf', 'https://cdn2.hubspot.net/hubfs/452859/Website_Files/PDF/Mortgage_Fee_Schedule.pdf?t=1467769363888', 'https://www.independentbank.com/hubfs/Business%20Fee%20Schedule.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/Online_ElectronicBankingAgreement.pdf', 'https://www.independentbank.com/hubfs/DP_ODP_Disclosure.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/ExtendedCoverageConsentForm.pdf', 'https://www.independentbank.com/hubfs/RetailFeeSchedule0224.pdf', 'https://www.independentbank.com/hubfs/640MI_MV2021-02.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/FundsAvailabilityNotice.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/substitute_check_policy_2016.pdf'], 'depth_2_html_links': ['https://www.independentbank.com/hubfs/Website_Files/PDF/BusinessFeeSchedule.pdf', 'https://www.independentbank.com/hubfs/Website_Files/PDF/OverdraftPrivilegeDisclosure.pdf'], 'files': []}
2025-08-31 17:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/accessibility-statement.html> (referer: https://nebat.com/privacy-notice.html)
2025-08-31 17:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkbank.com/estatements> (referer: https://www.linkbank.com/privacy-policy)
2025-08-31 17:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.snb-t.com/tools-services/forms-disclosures/> (referer: https://www.snb-t.com/privacy/)
2025-08-31 17:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://nebat.com/disclosures.html> (referer: https://nebat.com/privacy-notice.html)
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /holiday-closing.html HTTP/1.1" 200 0
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /regular-savings.html HTTP/1.1" 200 0
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /disclosures.html HTTP/1.1" 200 0
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.w3.org:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://www.w3.org:443 "HEAD /WAI/planning/statements/ HTTP/1.1" 200 0
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://nebat.com/accessibility-statement.html>
{'ID': '370', 'depth_2_html_saved': 'https://nebat.com/accessibility-statement.html', 'depth_2_pdf_links': [], 'depth_2_html_links': ['https://www.w3.org/WAI/planning/statements'], 'files': []}
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /privacy-policy HTTP/1.1" 200 0
2025-08-31 17:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /disclosures HTTP/1.1" 200 0
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.linkbank.com:443
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: https://www.linkbank.com:443 "HEAD /accessibility-feedback HTTP/1.1" 200 0
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2024/03/SNB-Personal-Loan-Application-Fillable-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Mortgage-Application.pdf HTTP/1.1" 200 0
2025-08-31 17:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Automatic-Withdrawal-Change-Form-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Direct-Deposit-Change-Form-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Bid-Slip-rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Change-of-Address-Request_rev.pdf HTTP/1.1" 200 0
2025-08-31 17:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/02/Consumer-Loan-Application.pdf HTTP/1.1" 404 0
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/03/Mortgage-Loan-Application.pdf HTTP/1.1" 200 0
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/03/Mortgage-Loan-Application.pdf HTTP/1.1" 200 None
2025-08-31 17:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /privacy/ HTTP/1.1" 200 0
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2021/05/online-banking-agreement-and-disclosure.pdf HTTP/1.1" 301 0
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /online-banking-agreement-and-disclosure HTTP/1.1" 301 0
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /wp-content/uploads/2024/03/online-banking-agreement-and-disclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:30 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2021/05/online-banking-agreement-and-disclosure.pdf HTTP/1.1" 301 0
2025-08-31 17:20:30 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /online-banking-agreement-and-disclosure HTTP/1.1" 301 0
2025-08-31 17:20:30 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "GET /wp-content/uploads/2024/03/online-banking-agreement-and-disclosure.pdf HTTP/1.1" 200 None
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.snb-t.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://www.snb-t.com:443 "HEAD /conforming-loan-payment-notice/ HTTP/1.1" 200 0
2025-08-31 17:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.snb-t.com/tools-services/forms-disclosures/>
{'ID': '817', 'depth_2_html_saved': 'https://www.snb-t.com/tools-services/forms-disclosures/', 'depth_2_pdf_links': ['https://www.snb-t.com/wp-content/uploads/2021/05/online-banking-agreement-and-disclosure.pdf', 'https://www.snb-t.com/wp-content/uploads/2021/03/Mortgage-Loan-Application.pdf'], 'depth_2_html_links': ['https://www.snb-t.com/wp-content/uploads/2021/02/Consumer-Loan-Application.pdf', 'https://www.snb-t.com/conforming-loan-payment-notice'], 'files': []}
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /holiday-closing.html HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /regular-savings.html HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/electronicbankingagreement.pdf HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/electronicbankingagreement.pdf HTTP/1.1" 200 282895
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/securityscheduleconsumer.pdf HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/securityscheduleconsumer.pdf HTTP/1.1" 200 145079
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/billpayagreement-personal.pdf HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/billpayagreement-personal.pdf HTTP/1.1" 200 178157
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/estatementagreement.pdf HTTP/1.1" 200 0
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:31 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/estatementagreement.pdf HTTP/1.1" 200 178632
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/advancedlogintermsofuse.pdf HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/advancedlogintermsofuse.pdf HTTP/1.1" 200 48703
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/business-electronic-banking-price-list.pdf HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/business-electronic-banking-price-list.pdf HTTP/1.1" 200 107182
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /business-enotice-agreement.html HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/accountservicesfeeschedule.pdf HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/accountservicesfeeschedule.pdf HTTP/1.1" 200 78068
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/businessaccountpricelist.pdf HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/businessaccountpricelist.pdf HTTP/1.1" 200 115255
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/depositaccountagreement-rulesregs.pdf HTTP/1.1" 200 0
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:32 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/depositaccountagreement-rulesregs.pdf HTTP/1.1" 200 320485
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/eftdisclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/eftdisclosure.pdf HTTP/1.1" 200 134269
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/nebatenvironmentalstatement.pdf HTTP/1.1" 200 0
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/nebatenvironmentalstatement.pdf HTTP/1.1" 200 22705
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/fundsavailabilityschedule.pdf HTTP/1.1" 200 0
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/fundsavailabilityschedule.pdf HTTP/1.1" 200 161943
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/yourbillingrights.pdf HTTP/1.1" 200 0
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/yourbillingrights.pdf HTTP/1.1" 200 21427
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/odpservicepolicy.pdf HTTP/1.1" 200 0
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/odpservicepolicy.pdf HTTP/1.1" 200 169387
2025-08-31 17:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/plocdisclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/plocdisclosure.pdf HTTP/1.1" 200 207529
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /sft1798/pmiannualdisclosure.pdf HTTP/1.1" 200 0
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "GET /sft1798/pmiannualdisclosure.pdf HTTP/1.1" 200 223477
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /company-culture.html HTTP/1.1" 200 0
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /privacy-notice.html HTTP/1.1" 200 0
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): nebat.com:443
2025-08-31 17:20:34 [urllib3.connectionpool] DEBUG: https://nebat.com:443 "HEAD /accessibility-statement.html HTTP/1.1" 200 0
2025-08-31 17:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://nebat.com/disclosures.html>
{'ID': '370', 'depth_2_html_saved': 'https://nebat.com/disclosures.html', 'depth_2_pdf_links': ['https://nebat.com/sft1798/odpservicepolicy.pdf', 'https://nebat.com/sft1798/electronicbankingagreement.pdf', 'https://nebat.com/sft1798/securityscheduleconsumer.pdf', 'https://nebat.com/sft1798/businessaccountpricelist.pdf', 'https://nebat.com/sft1798/billpayagreement-personal.pdf', 'https://nebat.com/sft1798/pmiannualdisclosure.pdf', 'https://nebat.com/sft1798/estatementagreement.pdf', 'https://nebat.com/sft1798/nebatenvironmentalstatement.pdf', 'https://nebat.com/sft1798/accountservicesfeeschedule.pdf', 'https://nebat.com/sft1798/business-electronic-banking-price-list.pdf', 'https://nebat.com/sft1798/depositaccountagreement-rulesregs.pdf', 'https://nebat.com/sft1798/eftdisclosure.pdf', 'https://nebat.com/sft1798/advancedlogintermsofuse.pdf', 'https://nebat.com/sft1798/yourbillingrights.pdf', 'https://nebat.com/sft1798/plocdisclosure.pdf', 'https://nebat.com/sft1798/fundsavailabilityschedule.pdf'], 'depth_2_html_links': ['https://nebat.com/company-culture.html', 'https://nebat.com/business-enotice-agreement.html'], 'files': []}
2025-08-31 17:20:34 [scrapy.core.engine] INFO: Closing spider (finished)
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: --- CRAWL SUMMARY ---
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Elapsed Time: Start time not set
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Total Crawled: 16
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Successful Crawls: 16
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Failed Crawls: 0
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Success Crawl Rate: 100.00%
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Total Downloads: 45
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Successful Downloads: 45
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Failed Downloads: 0
2025-08-31 17:20:34 [singlebank.spiders.multibank_sample] INFO: Success Download Rate: 100.00%
2025-08-31 17:20:34 [scrapy.extensions.feedexport] INFO: Stored csv feed (16 items) in: output.csv
2025-08-31 17:20:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 6853,
 'downloader/request_count': 26,
 'downloader/request_method_count/GET': 26,
 'downloader/response_bytes': 509253,
 'downloader/response_count': 26,
 'downloader/response_status_count/200': 22,
 'downloader/response_status_count/301': 4,
 'elapsed_time_seconds': 35.769528,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 8, 31, 21, 20, 34, 544754, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 3133027,
 'httpcompression/response_count': 22,
 'item_scraped_count': 16,
 'log_count/DEBUG': 380,
 'log_count/INFO': 21,
 'memusage/max': 73596928,
 'memusage/startup': 73596928,
 'request_depth_max': 2,
 'response_received_count': 22,
 'scheduler/dequeued': 26,
 'scheduler/dequeued/memory': 26,
 'scheduler/enqueued': 26,
 'scheduler/enqueued/memory': 26,
 'start_time': datetime.datetime(2025, 8, 31, 21, 19, 58, 775226, tzinfo=datetime.timezone.utc)}
2025-08-31 17:20:34 [scrapy.core.engine] INFO: Spider closed (finished)
