Log In Sign Up

petflight.com
robots.txt

Robots Exclusion Standard data for petflight.com

Resource Scan

Scan Details

Site Domain petflight.com
Base Domain petflight.com
Scan Status Ok
Last Scan2024-11-12T04:55:11+00:00
Next Scan 2024-11-19T04:55:11+00:00

Last Scan

Scanned2024-11-12T04:55:11+00:00
URL https://petflight.com/robots.txt
Redirect https://www.petflight.com/robots.txt
Redirect Domain www.petflight.com
Redirect Base petflight.com
Domain IPs 108.156.133.126, 108.156.133.76, 108.156.133.84, 108.156.133.87, 2600:9000:2816:0:a:d7fa:8300:93a1, 2600:9000:2816:1a00:a:d7fa:8300:93a1, 2600:9000:2816:3200:a:d7fa:8300:93a1, 2600:9000:2816:5200:a:d7fa:8300:93a1, 2600:9000:2816:5e00:a:d7fa:8300:93a1, 2600:9000:2816:9800:a:d7fa:8300:93a1, 2600:9000:2816:de00:a:d7fa:8300:93a1, 2600:9000:2816:e00:a:d7fa:8300:93a1
Redirect IPs 18.161.111.10, 18.161.111.2, 18.161.111.28, 18.161.111.64, 2600:9000:23d1:1c00:19:56de:f400:93a1, 2600:9000:23d1:4200:19:56de:f400:93a1, 2600:9000:23d1:5e00:19:56de:f400:93a1, 2600:9000:23d1:9200:19:56de:f400:93a1, 2600:9000:23d1:c00:19:56de:f400:93a1, 2600:9000:23d1:c200:19:56de:f400:93a1, 2600:9000:23d1:c400:19:56de:f400:93a1, 2600:9000:23d1:fc00:19:56de:f400:93a1
Response IP 108.156.22.57
Found Yes
Hash d0b842d87982a83e212e4911722753465460ec8283d7d5750330fda54e192d4b
SimHash 49051810c711

Groups

*

Rule Path
Disallow /admin/

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://sitemap.petflight.com/sitemap.xml.gz
Back to top