mega.fm
robots.txt

Robots Exclusion Standard data for mega.fm

Resource Scan

Scan Details

Site Domain mega.fm
Base Domain mega.fm
Scan Status Ok
Last Scan2024-06-07T05:40:16+00:00
Next Scan 2024-06-14T05:40:16+00:00

Last Scan

Scanned2024-06-07T05:40:16+00:00
URL https://mega.fm/robots.txt
Redirect https://megahits.sapo.pt/robots.txt
Redirect Domain megahits.sapo.pt
Redirect Base sapo.pt
Domain IPs 104.40.250.100
Redirect IPs 104.40.250.100
Response IP 104.40.250.100
Found Yes
Hash e40ca57bc2bd46d51af6278782960e5165631b2207f0a85d19fbde900e5109f0
SimHash 6904d144c533

Groups

googlebot-bard

Rule Path
Disallow /

openai-crawler

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Allow *

Other Records

Field Value
sitemap https://megahits.sapo.pt/sitemap.aspx