shoppingjin.pk
robots.txt

Robots Exclusion Standard data for shoppingjin.pk

Resource Scan

Scan Details

Site Domain shoppingjin.pk
Base Domain shoppingjin.pk
Scan Status Ok
Last Scan2024-11-14T14:35:48+00:00
Next Scan 2024-11-21T14:35:48+00:00

Last Scan

Scanned2024-11-14T14:35:48+00:00
URL https://shoppingjin.pk/robots.txt
Domain IPs 104.21.47.49, 172.67.144.138, 2606:4700:3032::6815:2f31, 2606:4700:3036::ac43:908a
Response IP 172.67.144.138
Found Yes
Hash b08abf372c1c9d51aee8a71383ed9ac8044eae877ce40496c98e2a4b5f44750c
SimHash 510c5e82c20a

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /cdn-cgi/*
Disallow /*blackhole
Disallow /?blackhole
Disallow */feed/
Disallow /wp-content/cache/*
Disallow /wp-content/plugins/*
Disallow /social-login/*
Disallow /newsletter/*
Disallow /mantainance/*
Disallow /wp-login.php?*
Disallow /my-account/*
Disallow /checkout/*
Disallow /cart/*
Disallow /brand/*
Disallow /categories/*
Disallow /product-category/*
Disallow /all/*
Allow /wp-content/*
Allow /wp-admin/admin-ajax.php
Allow */js/*
Allow */themes/*
Allow */css/*
Allow */uploads/*
Allow */fonts/*

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot
httrack
nutch

Rule Path
Disallow /

ahrefssiteaudit
mj12bot
ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://shoppingjin.pk/sitemap_index.xml