no.igotoworld.com
robots.txt

Robots Exclusion Standard data for no.igotoworld.com

Resource Scan

Scan Details

Site Domain no.igotoworld.com
Base Domain igotoworld.com
Scan Status Ok
Last Scan2025-09-20T09:25:11+00:00
Next Scan 2025-10-20T09:25:11+00:00

Last Scan

Scanned2025-09-20T09:25:11+00:00
URL https://no.igotoworld.com/robots.txt
Domain IPs 104.21.92.121, 172.67.193.1, 2606:4700:3033::ac43:c101, 2606:4700:3037::6815:5c79
Response IP 172.67.193.1
Found Yes
Hash bebcc4f527996c7423e073155be11d045659cabf3d17219ad2d877357eff5440
SimHash 6b28f8a2c0bf

Groups

*

Rule Path
Disallow /backend/
Disallow /newbackend/
Disallow /cache/
Disallow /framework/
Disallow /logs/
Disallow /vendors/
Disallow /rpc/
Disallow /poi_map/
Disallow /*/search/*
Disallow /Sitemap.php
Disallow /*?gclid*
Disallow /*?utm_campaign*
Disallow /*?period*
Disallow /*bookingRedirect*
Disallow /*fb_comment_id*

Other Records

Field Value
crawl-delay 4

semrushbot*

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Comments

  • Block all Semrush-related bots