appsgm.com
robots.txt

Robots Exclusion Standard data for appsgm.com

Resource Scan

Scan Details

Site Domain appsgm.com
Base Domain appsgm.com
Scan Status Ok
Last Scan2024-10-05T06:26:51+00:00
Next Scan 2024-10-12T06:26:51+00:00

Last Scan

Scanned2024-10-05T06:26:51+00:00
URL https://appsgm.com/robots.txt
Domain IPs 104.21.17.239, 172.67.178.221, 2606:4700:3030::6815:11ef, 2606:4700:3032::ac43:b2dd
Response IP 172.67.178.221
Found Yes
Hash ca536aafa69c0ff3cb8417ea3391d2d10f43609344658bcb080303279d22e220
SimHash 4a04c7702cbb

Groups

*

Rule Path
Disallow */similar/$
Disallow */similar$
Disallow /d?u=*
Disallow /r2?u=*
Disallow */dl?token=*
Disallow */dl/?token=*
Disallow */files/*
Disallow */files/*-zip$
Disallow */files/*-zip/$
Disallow */files/*-apk$
Disallow */files/*-apk/$
Disallow /developer/*
Disallow /lib/*
Disallow /*/developer/*
Disallow /apk-downloader/?q=*
Disallow /*/apk-downloader/?q=*

*

Rule Path
Allow /ads.txt

mediapartners-google

Rule Path
Allow /

sogou web spider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

addthis.com (http://support.addthis.com/)

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://appsgm.com/sitemap.xml