Tabix command of htslib can query a locus to a remote s3 file using s3:// protocol.

$ aws s3 ls s3://your_bucket/
vcf.gz
vcf.gz.tbi

$ tabix -l s3://your_bucket/vcf.gz
chr1
chr2