thetravelexpert.ie
robots.txt

Robots Exclusion Standard data for thetravelexpert.ie

Resource Scan

Scan Details

Site Domain thetravelexpert.ie
Base Domain thetravelexpert.ie
Scan Status Ok
Last Scan2024-09-28T03:49:24+00:00
Next Scan 2024-10-05T03:49:24+00:00

Last Scan

Scanned2024-09-28T03:49:24+00:00
URL https://thetravelexpert.ie/robots.txt
Domain IPs 35.214.254.101
Response IP 35.214.254.101
Found Yes
Hash 8f9ef2622bc0d46d5b12d1073a22631ac80c2c1287f37b7191c1f66e2df53472
SimHash c120ce08d6f7

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /author/

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap http://thetravelexpert.ie/post-sitemap.xml
sitemap http://thetravelexpert.ie/page-sitemap.xml
sitemap http://thetravelexpert.ie/category-sitemap.xml
sitemap http://thetravelexpert.ie/post_tag-sitemap.xml

Comments

  • WP Import Export Rule