egotter.com
robots.txt

Robots Exclusion Standard data for egotter.com

Resource Scan

Scan Details

Site Domain egotter.com
Base Domain egotter.com
Scan Status Ok
Last Scan2025-12-24T02:45:51+00:00
Next Scan 2025-12-31T02:45:51+00:00

Last Scan

Scanned2025-12-24T02:45:51+00:00
URL https://egotter.com/robots.txt
Domain IPs 18.178.36.35, 18.180.116.160
Response IP 18.180.116.160
Found Yes
Hash 342262c481b5ce81da8d043fed0b5c43ce00a70cfa2dad6354ea51298cc1ab55
SimHash b81dd4ea1553

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /profiles

*

Rule Path
Disallow /searches
Disallow /page_caches
Disallow /sign_in
Disallow /sign_out
Disallow /after_sign_in
Disallow /after_sign_up
Disallow /account_statuses
Disallow /follow
Disallow /settings
Disallow /common_friends
Disallow /notifications

Other Records

Field Value
sitemap https://egotter.com/sitemap.xml.gz