disneyparkadvisor.com
robots.txt

Robots Exclusion Standard data for disneyparkadvisor.com

Resource Scan

Scan Details

Site Domain disneyparkadvisor.com
Base Domain disneyparkadvisor.com
Scan Status Ok
Last Scan2024-11-16T02:09:15+00:00
Next Scan 2024-11-23T02:09:15+00:00

Last Scan

Scanned2024-11-16T02:09:15+00:00
URL https://disneyparkadvisor.com/robots.txt
Domain IPs 104.21.29.158, 172.67.149.112, 2606:4700:3036::ac43:9570, 2606:4700:3037::6815:1d9e
Response IP 172.67.149.112
Found Yes
Hash 4736a4a24efe6d92f432dab2b7428af5be09bca6ea2f3e94ee08eca219068005
SimHash 6ee4181ba4b1

Groups

*

Rule Path Comment
Disallow /*.js$ -
Disallow /*.js?* -
Disallow /*.css$ -
Disallow /*.css?* -
Disallow /*.php$ -
Disallow /wp-admin/ block access to admin section
Disallow /wp-login.php block access to admin section
Disallow /search/ block access to internal search result pages
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails
Disallow *%26preview%3D* block access to preview pages
Disallow /tag/ block access to tag pages
Disallow /404-error/ block access to 404 page
Disallow /wp-includes/ -
Disallow /wp-content/plugins/ -

Other Records

Field Value
sitemap https://disneyparkadvisor.com/sitemap_index.xml
sitemap https://disneyparkadvisor.com/post-sitemap.xml
sitemap https://disneyparkadvisor.com/page-sitemap.xml
sitemap https://disneyparkadvisor.com/category-sitemap.xml
sitemap https://disneyparkadvisor.com/post_tag-sitemap.xml
sitemap https://disneyparkadvisor.com/author-sitemap.xml

Comments

  • Block all JS and CSS files site-wide
  • Pointing crawlers to the sitemaps
  • Block non-essential directories