gransnet.com
robots.txt

Robots Exclusion Standard data for gransnet.com

Resource Scan

Scan Details

Site Domain gransnet.com
Base Domain gransnet.com
Scan Status Ok
Last Scan2024-10-06T01:51:02+00:00
Next Scan 2024-10-13T01:51:02+00:00

Last Scan

Scanned2024-10-06T01:51:02+00:00
URL https://gransnet.com/robots.txt
Redirect https://www.gransnet.com/robots.txt
Redirect Domain www.gransnet.com
Redirect Base gransnet.com
Domain IPs 104.22.52.134, 104.22.53.134, 172.67.21.245, 2606:4700:10::6816:3486, 2606:4700:10::6816:3586, 2606:4700:10::ac43:15f5
Redirect IPs 104.22.52.134, 104.22.53.134, 172.67.21.245, 2606:4700:10::6816:3486, 2606:4700:10::6816:3586, 2606:4700:10::ac43:15f5
Response IP 104.22.53.134
Found Yes
Hash 3ed7f8375ff6e385bdc0c9ed5fb394a9b79eefbff8f3c829ec3741c20e1d8ace
SimHash 9108d9438d73

Groups

*

Rule Path
Disallow /test/
Disallow /session
Disallow /signin
Disallow /version-choice
Disallow /register
Disallow /ReportTalkPost
Disallow /report-forum-post
Disallow /InTouch
Disallow /SearchArch
Disallow /SearchTalk
Disallow /search-forums
Disallow /member
Disallow /recipes/add
Disallow /recipes/find
Disallow /recipes/favourites
Disallow /forums/create-paid-thread
Disallow /Profile
Disallow /profile
Disallow /profile-photos
Disallow /report/save*

baiduspider

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

webvac

Rule Path
Disallow /

webzip

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

endeca

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

moodlebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gransnet.com/sitemap_index.xml
sitemap https://www.gransnet.com/sitemap_talk_index.xml

Warnings

  • 2 invalid lines.