worldsurfleague.com
robots.txt

Robots Exclusion Standard data for worldsurfleague.com

Resource Scan

Scan Details

Site Domain worldsurfleague.com
Base Domain worldsurfleague.com
Scan Status Ok
Last Scan2024-11-01T17:48:56+00:00
Next Scan 2024-11-08T17:48:56+00:00

Last Scan

Scanned2024-11-01T17:48:56+00:00
URL https://worldsurfleague.com/robots.txt
Redirect https://www.worldsurfleague.com/robots.txt
Redirect Domain www.worldsurfleague.com
Redirect Base worldsurfleague.com
Domain IPs 3.104.173.245, 54.206.221.145
Redirect IPs 3.104.173.245, 54.206.221.145
Response IP 3.104.173.245
Found Yes
Hash 1ffb8108a53626644d4e16bb4ce674025498a63ca0b3ae547436dff0b7b7f111
SimHash ba0590b0cff3

Groups

*

Rule Path
Disallow /search*
Disallow /auth*
Disallow /user*

Other Records

Field Value
sitemap https://www.worldsurfleague.com/rss/sitemap_articles.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_videos.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_collections.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_athletes.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_events.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_tours.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_pages.xml
sitemap https://www.worldsurfleague.com/rss/sitemap_google_news.xml