noxxic.com
robots.txt

Robots Exclusion Standard data for noxxic.com

Resource Scan

Scan Details

Site Domain noxxic.com
Base Domain noxxic.com
Scan Status Ok
Last Scan2024-09-26T17:16:56+00:00
Next Scan 2024-10-03T17:16:56+00:00

Last Scan

Scanned2024-09-26T17:16:56+00:00
URL https://noxxic.com/robots.txt
Redirect https://www.noxxic.com/robots.txt
Redirect Domain www.noxxic.com
Redirect Base noxxic.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.123, 76.76.21.98
Response IP 76.76.21.93
Found Yes
Hash 9dfdd2d1d3bb5c2a45e03ddb0c49f8be2980fff762130e700012aefe00f6a1e8
SimHash 781498607173

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

openai

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dataminer

Rule Path
Disallow /

*

Rule Path
Disallow /login
Disallow /contact
Disallow /terms-and-conditions
Disallow /privacy-policy
Disallow /expired

Other Records

Field Value
sitemap https://www.noxxic.com/sitemap.xml

Comments

  • www.robotstxt.org/