macopedia.com
robots.txt

Robots Exclusion Standard data for macopedia.com

Resource Scan

Scan Details

Site Domain macopedia.com
Base Domain macopedia.com
Scan Status Ok
Last Scan2024-09-16T04:11:26+00:00
Next Scan 2024-10-16T04:11:26+00:00

Last Scan

Scanned2024-09-16T04:11:26+00:00
URL https://macopedia.com/robots.txt
Domain IPs 176.119.51.6
Response IP 176.119.51.6
Found Yes
Hash 64507fb1b108ff529be529454014b8b6b2432c8be214496337b75ca0a2bb8bdd
SimHash cd67c863dcb0

Groups

*

Rule Path
Allow /
Allow /_assets/
Allow /typo3temp/
Disallow /headless/
Disallow /typo3/
Disallow /typo3conf/
Disallow /search/*
Disallow /*?id=*
Disallow /*cHash
Disallow /*tx_powermail_pi1
Disallow /*tx_form_formframework

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://macopedia.com/sitemap
sitemap https://macopedia.com/pl/sitemap
sitemap https://macopedia.com/de/sitemap

Comments

  • Block bots that don't benefit us.