noxxic.com
robots.txt

Robots Exclusion Standard data for noxxic.com

Resource Scan

Scan Details

Site Domain noxxic.com
Base Domain noxxic.com
Scan Status Ok
Last Scan2024-10-31T18:01:09+00:00
Next Scan 2024-11-07T18:01:09+00:00

Last Scan

Scanned2024-10-31T18:01:09+00:00
URL https://noxxic.com/robots.txt
Redirect https://www.noxxic.com/robots.txt
Redirect Domain www.noxxic.com
Redirect Base noxxic.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.61, 76.76.21.93
Response IP 76.76.21.123
Found Yes
Hash 32054bf4614e9cf617fca2e633e70d67812077bac34f108c919309e3c21074ab
SimHash 7815d8407573

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

openai

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dataminer

Rule Path
Disallow /

*

Rule Path
Disallow /login
Disallow /contact
Disallow /terms-and-conditions
Disallow /privacy-policy
Disallow /expired
Disallow /user

Other Records

Field Value
sitemap https://www.noxxic.com/sitemap.xml

Comments

  • www.robotstxt.org/