thammysen.vn
robots.txt

Robots Exclusion Standard data for thammysen.vn

Resource Scan

Scan Details

Site Domain thammysen.vn
Base Domain thammysen.vn
Scan Status Ok
Last Scan2024-09-04T02:50:44+00:00
Next Scan 2024-10-04T02:50:44+00:00

Last Scan

Scanned2024-09-04T02:50:44+00:00
URL https://thammysen.vn/robots.txt
Domain IPs 103.221.222.30
Response IP 103.221.222.30
Found Yes
Hash 6939f4ba300a8adfa5a9eee7be585d3c681d93d631ea5d5e2d4d48f60d8b5153
SimHash 691041b2d791

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-includes/js/
Allow /wp-content/uploads/
Allow /wp-content/

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image/1.0

Rule Path
Allow /

googlebot-video/1.0

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googleweblight

Rule Path
Allow /

google-searchbyimage

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

gigabot

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

naverbot

Rule Path
Allow /

yeti

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

coccocbot

Rule Path
Allow /

coccocbot-web

Rule Path
Allow /
Allow /wp-content/uploads/

coccocbot-image

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

twitterbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

adidxbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://thammysen.vn/sitemap_index.xml
sitemap https://thammysen.vn/post-sitemap.xml
sitemap https://thammysen.vn/page-sitemap.xml
sitemap https://thammysen.vn/category-sitemap.xml
sitemap https://thammysen.vn/author-sitemap.xml
sitemap https://thammysen.vn/news-sitemap.xml