amirite.net
robots.txt

Robots Exclusion Standard data for amirite.net

Resource Scan

Scan Details

Site Domain amirite.net
Base Domain amirite.net
Scan Status Ok
Last Scan2025-04-01T12:06:07+00:00
Next Scan 2025-04-08T12:06:07+00:00

Last Scan

Scanned2025-04-01T12:06:07+00:00
URL https://amirite.net/robots.txt
Redirect https://www.amirite.com/robots.txt
Redirect Domain www.amirite.com
Redirect Base amirite.com
Domain IPs 104.21.85.242, 172.67.212.139, 2606:4700:3037::6815:55f2, 2606:4700:3037::ac43:d48b
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash 7fcb60400574264e4e85403b283350b961bec46d35951acc5574bda7446d739c
SimHash 517cccc0e3b9

Groups

*

Rule Path
Disallow

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • Throttled bots
  • Blocked bots