timesmojo.com
robots.txt

Robots Exclusion Standard data for timesmojo.com

Resource Scan

Scan Details

Site Domain timesmojo.com
Base Domain timesmojo.com
Scan Status Ok
Last Scan2024-11-11T01:16:57+00:00
Next Scan 2024-11-18T01:16:57+00:00

Last Scan

Scanned2024-11-11T01:16:57+00:00
URL https://timesmojo.com/robots.txt
Domain IPs 174.142.205.102
Response IP 174.142.205.102
Found Yes
Hash 05a625eccadd94847574109d8d5713c50b02c212dd385836bd5c21d450a3dcca
SimHash c3059e48dc1b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /list/
Disallow /png/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grammarly

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

musobot

Rule Path
Disallow /

petal bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://www.timesmojo.com/sitemapindex.xml
sitemap https://www.timesmojo.com/sitemap-image.xml
sitemap https://www.timesmojo.com/sitemap-news.xml

Comments

  • WP Import Export Rule