This bundle will check a set of webpages every interval and index the result, time, size and optionally content and or crc of page(s).
To start:
Copy bundle into your etc/bundles directory
Modify the following arguements in urls.conf
For each url you wish to check, add a stanza like the following
mypage
url = http://www.mypage.com
timeout = 10
indexResults = false
userAgent = Mozilla/4.0
indexMD5 = false
indexResults = false
You can add as many pages above as you wish.
Make sure that each page has a unique name ex. mypage
If you index the Results, be careful the payload can be large.
If you have bugs or suggestions please let me know. erik@splunk.com.
Good luck!
e
- add in the filtering and matching from the imap bundle so you can filter content
- add back in the n level crawling
- add support for auth/login
As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 10GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps from Splunk, our partners and our community. Find an app for most any data source and user need, or simply create your own with help from our developer portal.