surfshopchallenge.com
robots.txt

Robots Exclusion Standard data for surfshopchallenge.com

Resource Scan

Scan Details

Site Domain surfshopchallenge.com
Base Domain surfshopchallenge.com
Scan Status Ok
Last Scan2024-11-09T06:11:22+00:00
Next Scan 2024-11-16T06:11:22+00:00

Last Scan

Scanned2024-11-09T06:11:22+00:00
URL https://surfshopchallenge.com/robots.txt
Redirect https://www.surfer.com/robots.txt
Redirect Domain www.surfer.com
Redirect Base surfer.com
Domain IPs 35.161.166.109, 35.165.38.2
Redirect IPs 151.101.130.98, 151.101.194.98, 151.101.2.98, 151.101.66.98
Response IP 151.101.2.98
Found Yes
Hash 51e007405efba69feab78eb86a8bfe3957cde4e693bf8a105354cada352f133d
SimHash 481d6c34cd13

Groups

*

Rule Path
Disallow /.api/
Disallow /api/

Other Records

Field Value
sitemap https://www.surfer.com/sitemaps.xml
sitemap https://www.surfer.com/news-sitemap.xml