Skip to content

Instantly share code, notes, and snippets.

View nenkoru's full-sized avatar

Ruslan Chernenko nenkoru

View GitHub Profile
@nenkoru
nenkoru / turbo1.5_turbo1.5_27b.txt
Last active April 1, 2026 18:37
Turboquant llama-bench on Nvidia V100
nenkoru@bayfut-ubuntu-v100-vgpu:~/turbo3-cuda$ ./build/bin/llama-bench -hf unsloth/Qwen3.5-27B-GGUF:UD-Q4_K_XL -fa on -ctv turbo1.5 -ctk turbo1.5 -d 0,10000,20000,30000,40000,50000,60000,70000,80000,90000,100000,150000,200000,250000
ggml_cuda_init: found 2 CUDA devices (Total VRAM: 40960 MiB):
Device 0: GRID V100DX-32Q, compute capability 7.0, VMM: no, VRAM: 32768 MiB
Device 1: GRID V100DX-8Q, compute capability 7.0, VMM: no, VRAM: 8192 MiB
common_download_file_single_online: using cached file: /home/nenkoru/.cache/huggingface/hub/models--unsloth--Qwen3.5-27B-GGUF/snapshots/3221f178a6b842d04f1fb42f1c413534adcc0a6a/Qwen3.5-27B-UD-Q4_K_XL.gguf
| model | size | params | backend | ngl | type_k | type_v | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -----: | -----: | --------------: | -------------------: |
| qwen35 27B Q4_K - Medium | 16.40 GiB | 26.90 B | CUDA | 99 | turbo1.5 |
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<title>Screen Capture Client</title>
</head>
<body>
<img id="screen" alt="Screen capture" />
<script>
const img = document.getElementById('screen');
variables() {
NSAPP=$(echo ${APP,,} | tr -d ' ') # This function sets the NSAPP variable by converting the value of the APP variable to lowercase and removing any spaces.
var_install="${NSAPP}-install" # sets the var_install variable by appending "-install" to the value of NSAPP.
INTEGER='^[0-9]+([.][0-9]+)?$' # it defines the INTEGER regular expression pattern.
}
# This function sets various color variables using ANSI escape codes for formatting text in the terminal.
color() {
YW=$(echo "\033[33m")
BL=$(echo "\033[36m")
@nenkoru
nenkoru / limits_override.ron
Created March 28, 2025 14:24
PowerTools limit override 4200/2200
Limits(
cpu: Limit(
provider: GabeBoy,
limits: GenericCpusLimit(
cpus: [GenericCpuLimit(
clock_min: Some(RangeLimit(
min: Some(1400),
max: Some(4200),
)),
clock_max: Some(RangeLimit(
@nenkoru
nenkoru / README.md
Last active February 17, 2025 04:15
How to enable streaming from Steam Deck using Sunshine without Flatpak with HW encoding
  1. Download an official release of sunshine with .AppImage extension on your Steam Deck. https://github.com/LizardByte/Sunshine/releases/tag/latest
  2. Move it to the home directory .local folder: mkdir -p ~/.local/sunshine/ && mv ~/Downloads/sunshine.AppImage ~/.local/sunshine/
  3. Add root user to the audio group: sudo usermod -aG audio root
  4. Execute the following to put the systemd unit file to autorun sunshine upon Steam Deck startup:
sudo tee /etc/systemd/system/sunshine.service << 'EOF'
[Unit]
StartLimitBurst=4

[Service]
@startuml
title Simplified example of how Alice's edge device dial of service would be processed in OpenZiti fabric
autonumber
Alice -> Controller: am I able to dial the service?
alt alice is able to dial
Controller -> Alice: controller returns a list of routers for the service
Alice -> Router: connects to the router with a dial request to the service
Router -> Service: dials the service
Service -> Router: returns bytes for the dial
Router -> Alice: relays response bytes
@nenkoru
nenkoru / ZDE.log
Created November 9, 2024 14:41
ZDE and remote ziti-edge-tunnel logs with wrong port forwarding
(79731)[2024-11-09T14:21:54.014Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
[2024-11-09T14:21:54:105Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.105Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
[2024-11-09T14:21:54:106Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.105Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.105Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3421/axQJEI2X/Connected] write 24 bytes
(79731)[2024-11-09T14:21:54.105Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3421/axQJEI2X/Connected] starting flusher
(79731)[2024-11-09T14:21
{
"allowedAddresses": [
"*.contoso.net"
],
"allowedPortRanges": [
{
"high": 138,
"low": 138
},
{
@nenkoru
nenkoru / hyperv-iscsi-eligible.ps1
Last active November 1, 2024 14:27
One-liner to get a JSON list of all iSCSI disks that are not attached to the host machine and are not attached to any of the Hyper-V VMs
Get-PhysicalDisk | Where-Object { $_.FriendlyName -like "*iSCSI*" -and -not ((Get-VM | Get-VMHardDiskDrive | Select-Object -ExpandProperty DiskNumber -ErrorAction SilentlyContinue) -contains $_.DeviceID) } | Where-Object { $driveLetters = Get-Volume | Select-Object -ExpandProperty DriveLetter -ErrorAction SilentlyContinue; $diskIndices = $driveLetters | ForEach-Object { $driveLetter = $_; Get-CimInstance CIM_LogicalDiskBasedOnPartition | Where-Object { $_.Dependent -like "*DeviceID = `"$driveLetter`:`"*"} | ForEach-Object { if ($_.Antecedent -match "Disk #(\d+)") { $matches[1] } } }; $diskIndices -notcontains $_.DeviceID } | ConvertTo-JSON
@nenkoru
nenkoru / dc-host.v1.json
Created September 15, 2024 21:07
OpenZiti DomainController intercept.v1 and host.v1 configs
{
"allowedAddresses":[
"*.mynet.contoso.com"
],
"allowedPortRanges":[
{
"high":138,
"low":138
},
{