metsul.com
robots.txt

Robots Exclusion Standard data for metsul.com

Resource Scan

Scan Details

Site Domain metsul.com
Base Domain metsul.com
Scan Status Ok
Last Scan2024-11-07T20:54:27+00:00
Next Scan 2024-11-14T20:54:27+00:00

Last Scan

Scanned2024-11-07T20:54:27+00:00
URL https://metsul.com/robots.txt
Domain IPs 104.21.48.162, 172.67.154.86, 2606:4700:3035::6815:30a2, 2606:4700:3035::ac43:9a56
Response IP 172.67.154.86
Found Yes
Hash ffd64e3f3de98175e2193d55f0e55c26c102f9e775abf08a924a63a8277f2a1d
SimHash 0113c148c6d0

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Disallow /premium/
Disallow /blog2012/
Disallow /blog-24hs/
Disallow /blog-24hs/*
Disallow /home/
Disallow /teste/
Disallow /secoes/
Disallow /modulo-radar/
Disallow /modulo-radar/*
Disallow /nginx_status
Disallow /nginx_status*
Disallow /nginx_status/*
Disallow /cdn-cgi/
Disallow /cdn-cgi/*
Disallow /?s=*
Disallow */feed
Disallow */feed/
Disallow *?et_blog
Disallow *?et_blog*
Disallow /__editor
Disallow /__editor/*
Disallow /videos/*
Disallow *?cod_blog=1
Disallow *?cod_blog=*
Disallow */amp/

twitterbot

Rule Path
Disallow

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

Other Records

Field Value
sitemap https://metsul.com/sitemap_index.xml
sitemap https://metsul.com/news-sitemap.xml