mypngstock.com
robots.txt

Robots Exclusion Standard data for mypngstock.com

Resource Scan

Scan Details

Site Domain mypngstock.com
Base Domain mypngstock.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-30T17:39:10+00:00
Next Scan 2024-10-07T17:39:10+00:00

Last Successful Scan

Scanned2024-09-22T17:38:26+00:00
URL https://mypngstock.com/robots.txt
Domain IPs 104.21.42.167, 172.67.163.176, 2606:4700:3031::ac43:a3b0, 2606:4700:3033::6815:2aa7
Response IP 172.67.163.176
Found Yes
Hash c58fcbb73dcd46441c8eea91dde590c8c7132fa00c27f07d97eaa3aed31e616f
SimHash 0305ddf86e13

Groups

*

Rule Path
Allow /
Disallow /download/
Disallow /ajax/
Disallow /colors/
Disallow /*page%3D
Disallow /cameras
Disallow /*/following
Disallow /*/followers
Disallow /collection
Disallow /?slug=

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mypngstock.com/sitemaps.xml
sitemap https://mypngstock.com/imageslist.xml
sitemap https://mypngstock.com/sitemaps-cat.xml
sitemap https://mypngstock.com/sitemaps-sub.xml
sitemap https://mypngstock.com/sitemaps-images.xml