easterneuropeantravel.com
robots.txt

Robots Exclusion Standard data for easterneuropeantravel.com

Resource Scan

Scan Details

Site Domain easterneuropeantravel.com
Base Domain easterneuropeantravel.com
Scan Status Ok
Last Scan2024-11-18T06:59:31+00:00
Next Scan 2024-11-25T06:59:31+00:00

Last Scan

Scanned2024-11-18T06:59:31+00:00
URL https://easterneuropeantravel.com/robots.txt
Redirect https://nomadnotmad.com/robots.txt
Redirect Domain nomadnotmad.com
Redirect Base nomadnotmad.com
Domain IPs 194.1.147.15, 194.1.147.98
Redirect IPs 104.21.58.120, 172.67.159.109, 2606:4700:3033::ac43:9f6d, 2606:4700:3037::6815:3a78
Response IP 104.21.58.120
Found Yes
Hash 390c7787114afade2fc0485f15e626f460165ae7bc7f3135c735929c2679c08f
SimHash 650898f243a1

Groups

scrapy

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20