Log In Sign Up

oradeahub.com
robots.txt

Robots Exclusion Standard data for oradeahub.com

Resource Scan

Scan Details

Site Domain oradeahub.com
Base Domain oradeahub.com
Scan Status Ok
Last Scan2024-09-10T10:16:08+00:00
Next Scan 2024-10-10T10:16:08+00:00

Last Scan

Scanned2024-09-10T10:16:08+00:00
URL https://oradeahub.com/robots.txt
Redirect https://www.oradeahub.com/robots.txt
Redirect Domain www.oradeahub.com
Redirect Base oradeahub.com
Domain IPs 176.96.138.245
Redirect IPs 176.96.138.245
Response IP 176.96.138.245
Found Yes
Hash 9d9abe7e227abedeea6c80fa10bcb30fa9f623bfca846071602672d3afb695ce
SimHash 844d9632ecf0

Groups

*

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

goodbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.oradeahub.com/sitemap/sitemap.xml
Back to top

Comments

  • Block CazoodleBot as it does not present correct accept content headers
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block dotbot as it cannot parse base urls properly
  • Sitemap
Back to top