SCRIPTS.md

Datalake ancillary scripts

Compress

tar --disable-copyfile -czf unlimited-speed.spl unlimited-speed

Check UF speed

sudo /opt/splunkforwarder/bin/splunk btool limits list thruput --debug

Secure Minio

Follow this setup from Mino docs. Use certgen -host minio from CertGen and put private.key and public.crt in ./certs/ directory

References

• Smartstore configuration
• Tag traffic GDI

Sample generator

echo "Current Time = `date`" >> ~splunk/heure.log

Ingest Action Ruleset

Troubleshoot

index="_internal" sourcetype="splunkd" (ERROR OR WARN) RfsOutputProcessor OR S3Client

Tagging inputs

See community blog

Create dummy data

index=_internal | head 10 | summaryindex spool=t uselb=t addtime=t index="cust0"

Roll the buckets

./scripts/roll.sh

Check the rolling

index=_internal component=HotBucketRoller

Check the upload to Smartstore

index=_internal component=CacheManager TERM(action=upload)