dns.exception.Timeout: The DNS operation timed out.
Hi,
I've got unhandled exception
Traceback (most recent call last):
File "/root/crawler/env/lib/python3.7/site-packages/dns_crawler/dns_utils.py", line 254, in get_record
response = dns.query.udp(request, resolver.nameservers[0], resolver.timeout)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 479, in udp
q.keyring, q.mac, ignore_trailing)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 425, in receive_udp
ignore_trailing=ignore_trailing)
File "/root/crawler/env/lib/python3.7/site-packages/dns/message.py", line 830, in from_wire
reader.read()
File "/root/crawler/env/lib/python3.7/site-packages/dns/message.py", line 750, in read
raise Truncated
dns.message.Truncated: The truncated flag is set.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/root/crawler/env/bin/dns-crawler", line 11, in <module>
load_entry_point('dns-crawler==1.3', 'console_scripts', 'dns-crawler')()
File "/root/crawler/env/lib/python3.7/site-packages/dns_crawler/single.py", line 48, in main
print(json.dumps(process_domain(domain)))
File "/root/crawler/env/lib/python3.7/site-packages/dns_crawler/crawl.py", line 100, in process_domain
dns_local = get_dns_local(domain)
File "/root/crawler/env/lib/python3.7/site-packages/dns_crawler/crawl.py", line 54, in get_dns_local
"DNSKEY": annotate_dns_algorithm(get_record(domain, "DNSKEY", local_resolver), "value", 2),
File "/root/crawler/env/lib/python3.7/site-packages/dns_crawler/dns_utils.py", line 256, in get_record
response = dns.query.tcp(request, resolver.nameservers[0], resolver.timeout)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 661, in tcp
q.keyring, q.mac, ignore_trailing)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 585, in receive_tcp
ldata = _net_read(sock, 2, expiration)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 500, in _net_read
_wait_for_readable(sock, expiration)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 173, in _wait_for_readable
_wait_for(s, True, False, True, expiration)
File "/root/crawler/env/lib/python3.7/site-packages/dns/query.py", line 149, in _wait_for
raise dns.exception.Timeout
dns.exception.Timeout: The DNS operation timed out.
I run the dns-crawler on some tesing domain.
I've got error on domain 007shop.sk
, but not on every run.
regards Peter