bcnmes.com
robots.txt

Robots Exclusion Standard data for bcnmes.com

Resource Scan

Scan Details

Site Domain bcnmes.com
Base Domain bcnmes.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-23T11:21:00+00:00
Next Scan 2024-12-22T11:21:00+00:00

Last Successful Scan

Scanned2024-05-27T10:28:40+00:00
URL https://bcnmes.com/robots.txt
Domain IPs 134.0.11.62
Response IP 134.0.11.62
Found Yes
Hash 23bd14125d9f5c453ce7fdb102aaeb673d8e709865e6ad203eba9f0e449812e8
SimHash c2029e11c56b

Groups

scrapy

Rule Path
Disallow /

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /about-quienes-somos/action~posterboard/
Disallow /about-quienes-somos/action~agenda/
Disallow /about-quienes-somos/action~oneday/
Disallow /about-quienes-somos/action~month/
Disallow /about-quienes-somos/action~week/
Disallow /about-quienes-somos/action~stream/
Disallow /about-quienes-somos/action~undefined/
Disallow /about-quienes-somos/action~http%3A/
Disallow /about-quienes-somos/action~default/
Disallow /about-quienes-somos/action~poster/
Disallow /about-quienes-somos/action~*/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

gnowitnewsbot

Rule Path
Disallow /

Comments

  • WP Import Export Rule