topstarnews.net
robots.txt

Robots Exclusion Standard data for topstarnews.net

Resource Scan

Scan Details

Site Domain topstarnews.net
Base Domain topstarnews.net
Scan Status Ok
Last Scan2024-06-13T15:50:02+00:00
Next Scan 2024-06-20T15:50:02+00:00

Last Scan

Scanned2024-06-13T15:50:02+00:00
URL https://topstarnews.net/robots.txt
Domain IPs 101.101.208.10
Response IP 101.101.208.10
Found Yes
Hash 3273a3c91b2e2c5ed76cf7f4cdc1c6ff9ec6fd0267a328a38a605688d59fc756
SimHash 6b356cc58c98

Groups

*

Rule Path
Disallow /admin/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.topstarnews.net/sitemap.xml
sitemap https://www.topstarnews.net/sitemap-index.xml
sitemap https://www.topstarnews.net/sitemap_image.xml
sitemap https://www.topstarnews.net/sitemap_video.xml
sitemap https://www.topstarnews.net/news_google.xml

Comments

  • Robots for topstarnews.net
  • SiteMap
  • DaumWebMasterTool:05de4cc3fe5fad6426a2aace43782d49211cf286eeb4d48175595684329226be:xjc60NJ+23sJkTGGRLnC4A==