Skip to content

Instantly share code, notes, and snippets.

View byteSamurai's full-sized avatar

Alfred Feldmeyer byteSamurai

View GitHub Profile
@byteSamurai
byteSamurai / 01_enable-services.sh
Last active February 3, 2022 14:49 — forked from vanpelt/01_enable-services.sh
Local init scripts
#!/bin/bash
# move all services to runit, was tricky to make this happen in docker without
# overwriting cron / sshd
echo "*** Copying services to runit"
cp -R /home/wandb/service/* /etc/service/
cp -R /home/wandb/wandb-logrotate /etc/logrotate.d/
HOST=${HOST:-http://localhost:8080}
import glob
import tensorflow as tf
# Get matching filenames
pattern = '../../test-images/*.jpg.*' # A bunch of 299x299x3 jpegs
matching_filenames = glob.iglob(pattern)
# Pipeline settings
NUM_GPUS = 2
BATCH_SIZE = 32
#!/bin/bash -xe
# requires jq and 3 brokers to start
which jq || echo 'no jq found, bye!' && exit 1
ZK_HOST=zkhost1:2181/kafka
# record all topics
/usr/local/kafka/bin/kafka-topics.sh --zookeeper $ZK_HOST --list > all_topics
# generate json for listing which topics to reassign