Log In Sign Up

petflight.com
robots.txt

Robots Exclusion Standard data for petflight.com

Resource Scan

Scan Details

Site Domain petflight.com
Base Domain petflight.com
Scan Status Ok
Last Scan2024-10-07T18:13:45+00:00
Next Scan 2024-10-14T18:13:45+00:00

Last Scan

Scanned2024-10-07T18:13:45+00:00
URL https://petflight.com/robots.txt
Redirect https://www.petflight.com/robots.txt
Redirect Domain www.petflight.com
Redirect Base petflight.com
Domain IPs 108.156.133.126, 108.156.133.76, 108.156.133.84, 108.156.133.87, 2600:9000:2755:0:a:d7fa:8300:93a1, 2600:9000:2755:1800:a:d7fa:8300:93a1, 2600:9000:2755:6400:a:d7fa:8300:93a1, 2600:9000:2755:a200:a:d7fa:8300:93a1, 2600:9000:2755:bc00:a:d7fa:8300:93a1, 2600:9000:2755:c200:a:d7fa:8300:93a1, 2600:9000:2755:d000:a:d7fa:8300:93a1, 2600:9000:2755:f000:a:d7fa:8300:93a1
Redirect IPs 2600:9000:20fe:2c00:19:56de:f400:93a1, 2600:9000:20fe:9400:19:56de:f400:93a1, 2600:9000:20fe:9800:19:56de:f400:93a1, 2600:9000:20fe:ae00:19:56de:f400:93a1, 2600:9000:20fe:d600:19:56de:f400:93a1, 2600:9000:20fe:e000:19:56de:f400:93a1, 2600:9000:20fe:ea00:19:56de:f400:93a1, 2600:9000:20fe:fa00:19:56de:f400:93a1, 65.9.95.124, 65.9.95.127, 65.9.95.37, 65.9.95.92
Response IP 108.156.22.6
Found Yes
Hash d0b842d87982a83e212e4911722753465460ec8283d7d5750330fda54e192d4b
SimHash 49051810c711

Groups

*

Rule Path
Disallow /admin/

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://sitemap.petflight.com/sitemap.xml.gz
Back to top