fitness.meta.stackexchange.com
robots.txt

Robots Exclusion Standard data for fitness.meta.stackexchange.com

Resource Scan

Scan Details

Site Domain fitness.meta.stackexchange.com
Base Domain stackexchange.com
Scan Status Ok
Last Scan2024-10-23T17:17:32+00:00
Next Scan 2024-11-22T17:17:32+00:00

Last Scan

Scanned2024-10-23T17:17:32+00:00
URL https://fitness.meta.stackexchange.com/robots.txt
Domain IPs 104.18.43.226, 172.64.144.30
Response IP 104.18.43.226
Found Yes
Hash c2b91a40901a10646635e71dd3c8775cd8e5734f0a12febf830e4298f6eacd6d
SimHash 5c82c995beec

Groups

*

Rule Path
Disallow /posts/
Disallow /posts?
Disallow /amzn/click/
Disallow /questions/ask/
Disallow /questions/ask?
Disallow /search/
Disallow /search?
Disallow /feeds/
Disallow /feeds?
Disallow /users/login/
Disallow /users/login?
Disallow /users/logout/
Disallow /users/logout?
Disallow /users/filter/
Disallow /users/filter?
Disallow /users/signup
Disallow /users/signup/
Disallow /users/signup?
Disallow /users/authenticate/
Disallow /users/authenticate?
Disallow /users/oauth/*
Disallow /users/flag-summary/
Disallow /users/flair/
Disallow /users/flair?
Disallow /users/activity/
Disallow /users/activity/?
Disallow /users/stats/
Disallow /users/*?tab=accounts
Disallow /users/*?tab=activity
Disallow /users/rep/show
Disallow /users/rep/show?
Disallow /unanswered/
Disallow /unanswered?
Disallow /u/
Disallow /messages/
Disallow /api/*
Disallow /review/*
Disallow /*/ivc/*
Disallow /*?lastactivity
Disallow /users/login/global/request/
Disallow /users/login/global/request?
Disallow /questions/*answertab%3D*
Disallow /questions/tagged/*%2B*
Disallow /questions/tagged/*%20*
Disallow /questions/*/answer/submit
Disallow /tags/*%2B*
Disallow /tags/*%20*
Disallow /suggested-edits/
Disallow /suggested-edits?
Disallow /ajax/
Disallow /plugins/
Disallow /error
Disallow /gps/*
Disallow /10m
Disallow /jobs/cv/sign-up-and-create
Disallow /jobs/n/*
Disallow /jobs/a/*
Disallow /jobs/apply/*
Disallow /jobs/companies/n/*
Disallow /jobs/companies/a/*
Disallow /jobs/*/more-jobs-count
Disallow /jobs/email-job
Disallow /emails/*
Disallow /_/*
Allow /

yahoo pipes 1.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

aizbot

Rule Path
Disallow /

aizbot-dolma

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /*/ivc/*
Disallow /users/flair/
Disallow /jobs/n/*
Disallow /jobs/a/*
Disallow /jobs/companies/n/*
Disallow /jobs/companies/a/*

Other Records

Field Value
sitemap https://fitness.meta.stackexchange.com/sitemap.xml

Warnings

  • 2 invalid lines.