gignets.com
robots.txt

Robots Exclusion Standard data for gignets.com

Resource Scan

Scan Details

Site Domain gignets.com
Base Domain gignets.com
Scan Status Ok
Last Scan2025-09-25T18:38:23+00:00
Next Scan 2025-10-25T18:38:23+00:00

Last Scan

Scanned2025-09-25T18:38:23+00:00
URL https://gignets.com/robots.txt
Domain IPs 2a02:4780:84:725f:4078:cd6e:ecd2:d2ae, 2a02:4780:84:9f3f:e8ce:cc1a:aba0:b3f1, 84.32.84.119, 84.32.84.88
Response IP 179.61.189.197
Found Yes
Hash 0a846a359b383ac2e5d7eaf418f119b392e5e27c5966271a2ffc47518839dc72
SimHash 6010d5709233

Groups

*

Rule Path
Allow /

chatgpt
gptbot
chatgpt-user
oai-search
bard
gemini
oai-searchbot
openai
generativeai
predictiveai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://gignets.com/sitemap.xml

Comments

  • Allow AI and generative bots with crawl delay