Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Can I use an opened gzip file with Popen in Python?

I have a little command line tool that reads from stdin. On the command line I would run either...

./foo < bar

or ...

cat bar | ./foo

With a gziped file I can run

zcat bar.gz | ./foo

in Python I can do ...

Popen(["./foo", ], stdin=open('bar'), stdout=PIPE, stderr=PIPE)

but I can't do

import gzip
Popen(["./foo", ], stdin=gzip.open('bar'), stdout=PIPE, stderr=PIPE)

I wind up having to run

p0 = Popen(["zcat", "bar"], stdout=PIPE, stderr=PIPE)
Popen(["./foo", ], stdin=p0.stdout, stdout=PIPE, stderr=PIPE)

Am I doing something wrong? Why can't I use gzip.open('bar') as an stdin arg to Popen?

like image 964
eric.frederich Avatar asked Apr 28 '10 20:04

eric.frederich


1 Answers

Because the 'stdin' and 'stdout' of the subprocess takes file descriptor (which is a number), which is an operating system resource. This is masked by the fact that if you pass an object, the subprocess module checks whether the object has a 'fileno' attribute and if it has, it will use it.

The 'gzip' object is not something an operating system provides. An open file is, a socket is, a pipe is. Gzip object is an object that provides read() and write() methods but no fileno attribute.

You can look at the communicate() method of subprocess though, you might want to use it.

like image 190
ondra Avatar answered Sep 30 '22 11:09

ondra