magazinelib.com
robots.txt
Robots Exclusion Standard data for magazinelib.com
Resource Scan
Scan Details
| Site Domain | magazinelib.com |
| Base Domain | magazinelib.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-10T10:18:56+00:00 |
| Next Scan | 2024-10-08T10:18:56+00:00 |
Last Successful Scan
| Scanned | 2023-09-14T08:19:06+00:00 |
| URL | https://magazinelib.com/robots.txt |
| Domain IPs | 104.21.93.11, 172.67.202.67, 2606:4700:3035::ac43:ca43, 2606:4700:3036::6815:5d0b |
| Response IP | 104.21.93.11 |
| Found | Yes |
| Hash | 2f53b4afa57b2ed131e1a2c340e28ca235c5e26098ef1c62cce8aaa73bce19d7 |
| SimHash | 08c82d1a6b12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-json/ |
| Disallow | /xmlrpc.php |
| Disallow | /readme.html |
| Disallow | /*? |
| Disallow | /?s= |
| Disallow | /?blackhole |
| Disallow | */attachment/* |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /?s=biology%2Btoday |
| Allow | /?s=readers%2Bdigest |
| Allow | /?s=physics%2Bfor%2Byou |
| Allow | /?s=chemistry%2Btoday |
| Allow | /?s=mathematics%2Btoday |
| Allow | /?s=men%27s%2Bhealth |
| Allow | /?s=flex |
| Allow | /?s=the%2Beconomist |
| Allow | /?s=nphoto%2Bmagazine |
| Allow | /?s=muscle%2Band%2Bfitness |
| Allow | /?s=better%2Bphotography |
| Allow | /?s=bbc%2Bknowledge |
| Allow | /?s=how%2Bit%2Bworks |
| Allow | /?s=National%2BGeographic |
| Allow | /?s=New%2BScientist |
| Allow | /?s=The%2BTimes%2Bnewspaper |
| Allow | /?s=Financial%2BTimes%2Bnewspaper |
| Allow | /?s=Newsweek |
| Allow | /?s=Elle%2Bitalia |
| Allow | /?s=Elle%2BUSA |
| Allow | /?s=Elle%2BUK |
| Allow | /?s=Elle%2BAustralia |
| Allow | /?s=Elle%2BDecor |
| Allow | /?s=Philosophy%2BNow |
| Allow | /?s=Vogue%2BUSA |
| Allow | /?s=Vogue%2BUK |
| Allow | /?s=Vogue%2BBrazil |
| Allow | /?s=Vogue%2BAustralia |
| Allow | /?s=GQ |
| Allow | /?s=3D%2BWorld |
| Allow | /?s=Harper%E2%80%99s%2BBazaar |
| Allow | /?s=Tech%2BMagazine |
| Allow | /?s=The%2BAtlantic |
| Allow | /?s=The%2BNew%2BYork%2BTimes%2Bnewspaper |
| Allow | /?s=Lonely%2BPlanet |
| Allow | /?s=The%2BGuardian |
| Allow | /?s=BBC%2BFocus |
| Allow | /?s=Scientific%2BAmerican |
| Allow | /?s=Daily%2BExpress%2Bnewspaper |
| Allow | /?s=Global%2BTraveler |
| Allow | /?s=Fast%2BCompany |
| Allow | /?s=New%2BYork%2BMagazine |
| Allow | /?s=Food%2BNetwork%2BMagazine |
| Allow | /?s=Australian%2BPhotography |
| Allow | /?s=The%2BWeek |
| Allow | /?s=Sunday%2BExpress%2Bnewspaper |
| Allow | /?s=Total%2BGuitar |
| Allow | /?s=Forbes |
| Allow | /?s=OM%2BYoga |
| Allow | /?s=Master%2BPhotography |
| Allow | /?s=Der%2BSpiegel |
| Allow | /?s=Star%2BMagazine |
Other Records
| Field | Value |
|---|---|
| sitemap | https://magazinelib.com/sitemap.xml/ |
Warnings
- `host` is not a known field.