surfermag.com
robots.txt

Robots Exclusion Standard data for surfermag.com

Resource Scan

Scan Details

Site Domain surfermag.com
Base Domain surfermag.com
Scan Status Ok
Last Scan2024-11-14T15:09:40+00:00
Next Scan 2024-11-21T15:09:40+00:00

Last Scan

Scanned2024-11-14T15:09:40+00:00
URL https://surfermag.com/robots.txt
Redirect https://www.surfer.com/robots.txt
Redirect Domain www.surfer.com
Redirect Base surfer.com
Domain IPs 35.161.166.109, 35.165.38.2
Redirect IPs 151.101.130.98, 151.101.194.98, 151.101.2.98, 151.101.66.98
Response IP 151.101.130.98
Found Yes
Hash 51e007405efba69feab78eb86a8bfe3957cde4e693bf8a105354cada352f133d
SimHash 481d6c34cd13

Groups

*

Rule Path
Disallow /.api/
Disallow /api/

Other Records

Field Value
sitemap https://www.surfer.com/sitemaps.xml
sitemap https://www.surfer.com/news-sitemap.xml