timesmojo.com
robots.txt

Robots Exclusion Standard data for timesmojo.com

Resource Scan

Scan Details

Site Domain timesmojo.com
Base Domain timesmojo.com
Scan Status Ok
Last Scan2024-09-29T14:13:03+00:00
Next Scan 2024-10-06T14:13:03+00:00

Last Scan

Scanned2024-09-29T14:13:03+00:00
URL https://timesmojo.com/robots.txt
Domain IPs 174.142.205.102
Response IP 174.142.205.102
Found Yes
Hash 32f5ff46c882d6da43b25ed2d43b67c435b31ea9bb1dea452ad9fdec47a96f90
SimHash 81219e60ce0b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /list/
Disallow /png/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grammarly

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://www.timesmojo.com/sitemapindex.xml
sitemap https://www.timesmojo.com/sitemap-image.xml
sitemap https://www.timesmojo.com/sitemap-news.xml

Comments

  • WP Import Export Rule