brians-retro-ai.com
robots.txt

Robots Exclusion Standard data for brians-retro-ai.com

Resource Scan

Scan Details

Site Domain brians-retro-ai.com
Base Domain brians-retro-ai.com
Scan Status Ok
Last Scan2024-06-12T08:52:04+00:00
Next Scan 2024-07-12T08:52:04+00:00

Last Scan

Scanned2024-06-12T08:52:04+00:00
URL https://brians-retro-ai.com/robots.txt
Domain IPs 192.0.78.155, 192.0.78.239
Response IP 192.0.78.239
Found Yes
Hash 2f8efa974d5552a521720d7dd64280f0ee4c2f9ab1a4e932ad8e7a36939c4b36
SimHash 2a6ddfa0ada4

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

krowler

Rule Path
Disallow /

owler

Rule Path
Disallow /

owler-bot

Rule Path
Disallow /

*

Rule Path
Disallow /*.zip$

*

Rule Path
Disallow /?smd$

*

Rule Path
Disallow /htdocs/wp-content/uploads/Flightplans/

*

Rule Path
Disallow /htdocs/wp-content/uploads/Paints/

Other Records

Field Value
sitemap https://brians-retro-ai.com/sitemap.xml
sitemap https://brians-retro-ai.com/news-sitemap.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/