ok
Mini Shell
# Changelog
All notable changes to `robots-txt` will be documented in this file
## 2.0.1 - 2021-05-06
- added x-robots-tag: none (#32)
## 2.0.0 - 2021-03-28
- require PHP 8+
- drop support for PHP 7.x
- convert syntax to PHP 8
- remove deprecated methods
- use php-cs-fixer & github workflow
## 1.0.10 - 2020-12-08
- handle multiple user-agent (#29)
## 1.0.9 - 2020-11-27
- add support for PHP 8.0 + move to GitHub actions (#27)
## 1.0.8 - 2020-09-12
- make user agent checks case-insensitive
## 1.0.7 - 2020-04-29
- fix find robots meta tag line if minified code (#23)
## 1.0.6 - 2020-04-07
- fix headers checking (nofollow, noindex) for custom userAgent (#21)
## 1.0.5 - 2019-08-08
- improvements around handling of wildcards, end-of-string, query string
## 1.0.4 - 2019-08-07
- improve readability
## 1.0.3 - 2019-03-11
- fix parsing robotstxt urls with keywords (#14)
## 1.0.2 - 2019-01-11
- make robots.txt check case insensitive
## 1.0.1 - 2018-05-07
- prevent exception if the domain has no robots.txt
## 1.0.0 - 2018-05-07
- initial release
Zerion Mini Shell 1.0