Log In Sign Up

essayrx.com
robots.txt

Robots Exclusion Standard data for essayrx.com

Resource Scan

Scan Details

Site Domain essayrx.com
Base Domain essayrx.com
Scan Status Ok
Last Scan2025-04-03T06:45:58+00:00
Next Scan 2025-05-03T06:45:58+00:00

Last Scan

Scanned2025-04-03T06:45:58+00:00
URL https://essayrx.com/robots.txt
Domain IPs 104.21.88.146, 172.67.184.198, 2606:4700:3030::6815:5892, 2606:4700:3033::ac43:b8c6
Response IP 104.21.88.146
Found Yes
Hash 70225a28a8bd672a85fb1616e10f1b190dfe538b0294e24b77c748a2fb0ef93a
SimHash 5814505084b3

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

gemini

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow /*%26
Back to top

Other Records

Field Value
sitemap https://essayrx.com/sitemap.xml
Back to top