Log In Sign Up

therepairmanual.com
robots.txt

Robots Exclusion Standard data for therepairmanual.com

Resource Scan

Scan Details

Site Domain therepairmanual.com
Base Domain therepairmanual.com
Scan Status Ok
Last Scan2024-05-05T18:57:09+00:00
Next Scan 2024-06-04T18:57:09+00:00

Last Scan

Scanned2024-05-05T18:57:09+00:00
URL https://therepairmanual.com/robots.txt
Domain IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Response IP 151.101.195.52
Found Yes
Hash 1daa8ddbe883472e20ebb829fae88ea17e0d2aef5e29146076c030530a89038c
SimHash d522cc6074a9

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/woo-import-export/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot
gigabot
barkrowler
blexbot
magpie-crawler
domain re-animator bot
obot
turnitinbot
mj12bot
dataforseobot

Rule Path
Disallow /
Back to top

Comments

  • WP Import Export Rule
  • Limit bots
  • Ban bots
Back to top