hinduism.stackexchange.com
robots.txt

Robots Exclusion Standard data for hinduism.stackexchange.com

Resource Scan

Scan Details

Site Domain hinduism.stackexchange.com
Base Domain stackexchange.com
Scan Status Ok
Last Scan2024-05-18T04:42:02+00:00
Next Scan 2024-06-01T04:42:02+00:00

Last Scan

Scanned2024-05-18T04:42:02+00:00
URL https://hinduism.stackexchange.com/robots.txt
Domain IPs 104.18.43.226, 172.64.144.30
Response IP 104.18.43.226
Found Yes
Hash ef6267007e88ad02159000f2b8b43687555de60660675b51dd93cf72225181e3
SimHash 1c82c1969aff

Groups

*

Rule Path
Disallow /posts/
Disallow /posts?
Disallow /amzn/click/
Disallow /questions/ask/
Disallow /questions/ask?
Disallow /search/
Disallow /search?
Disallow /feeds/
Disallow /feeds?
Disallow /users/login/
Disallow /users/login?
Disallow /users/logout/
Disallow /users/logout?
Disallow /users/filter/
Disallow /users/filter?
Disallow /users/signup
Disallow /users/signup/
Disallow /users/signup?
Disallow /users/authenticate/
Disallow /users/authenticate?
Disallow /users/oauth/*
Disallow /users/flag-summary/
Disallow /users/flair/
Disallow /users/flair?
Disallow /users/activity/
Disallow /users/activity/?
Disallow /users/stats/
Disallow /users/*?tab=accounts
Disallow /users/*?tab=activity
Disallow /users/rep/show
Disallow /users/rep/show?
Disallow /unanswered/
Disallow /unanswered?
Disallow /u/
Disallow /messages/
Disallow /api/*
Disallow /review/*
Disallow /*/ivc/*
Disallow /*?lastactivity
Disallow /users/login/global/request/
Disallow /users/login/global/request?
Disallow /questions/*answertab%3D*
Disallow /questions/tagged/*%2B*
Disallow /questions/tagged/*%20*
Disallow /questions/*/answer/submit
Disallow /tags/*%2B*
Disallow /tags/*%20*
Disallow /suggested-edits/
Disallow /suggested-edits?
Disallow /ajax/
Disallow /plugins/
Disallow /error
Disallow /gps/*
Disallow /10m
Disallow /jobs/cv/sign-up-and-create
Disallow /jobs/n/*
Disallow /jobs/a/*
Disallow /jobs/apply/*
Disallow /jobs/companies/n/*
Disallow /jobs/companies/a/*
Disallow /jobs/*/more-jobs-count
Disallow /jobs/email-job
Disallow /emails/*
Disallow /_/*
Allow /

yahoo pipes 1.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /*/ivc/*
Disallow /users/flair/
Disallow /jobs/n/*
Disallow /jobs/a/*
Disallow /jobs/companies/n/*
Disallow /jobs/companies/a/*

Other Records

Field Value
sitemap https://hinduism.stackexchange.com/sitemap.xml

Warnings

  • 2 invalid lines.