scamninjas.com
robots.txt

Robots Exclusion Standard data for scamninjas.com

Resource Scan

Scan Details

Site Domain scamninjas.com
Base Domain scamninjas.com
Scan Status Ok
Last Scan2025-11-03T17:06:17+00:00
Next Scan 2025-11-10T17:06:17+00:00

Last Scan

Scanned2025-11-03T17:06:17+00:00
URL https://scamninjas.com/robots.txt
Redirect https://www.scamorlegit.ai/robots.txt
Redirect Domain www.scamorlegit.ai
Redirect Base scamorlegit.ai
Domain IPs 104.21.83.146, 172.67.177.114, 2606:4700:3034::6815:5392, 2606:4700:3035::ac43:b172
Redirect IPs 104.21.13.178, 172.67.156.222, 2606:4700:3030::ac43:9cde, 2606:4700:3035::6815:db2
Response IP 104.21.13.178
Found Yes
Hash a8f4ea298310962d5d8d5e036b55ac3130fec4d597578f5a96b58959fd271343
SimHash 6208f880c891

Groups

*

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap http://localhost/sitemap.xml

Comments

  • Sitemap location