diff options
| author | Dennis Eriksen <d@ennis.no> | 2018-08-05 16:41:02 +0200 |
|---|---|---|
| committer | Dennis Eriksen <d@ennis.no> | 2018-08-05 16:41:02 +0200 |
| commit | a2b0e780406419caed70d815bec745b6962591a3 (patch) | |
| tree | 38753233ca13881085e531a55d98144d0269e1d8 /static/robots.txt | |
| parent | Initial commit (diff) | |
| download | rikerz-a2b0e780406419caed70d815bec745b6962591a3.tar.gz | |
sample index with html5boilerplate
Diffstat (limited to 'static/robots.txt')
| -rw-r--r-- | static/robots.txt | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/static/robots.txt b/static/robots.txt new file mode 100644 index 0000000..d0e5f1b --- /dev/null +++ b/static/robots.txt @@ -0,0 +1,5 @@ +# www.robotstxt.org/ + +# Allow crawling of all content +User-agent: * +Disallow: |