Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Overriding the newline generation behaviour of Python's print statement

I have a bunch of legacy code for encoding raw emails that contains a lot of print statements such as

print >>f, "Content-Type: text/plain"

This is all well and good for emails, but we're now leveraging the same code for outputting HTTP request. The problem is that the Python print statement outputs '\n' whilst HTTP requires '\r\n'.

It looks like Python (2.6.4 at least) generates a trailing PRINT_NEWLINE byte code for a print statement which is implemented as

ceval.c:1582: err = PyFile_WriteString("\n", w);

Thus it appears there's no easy way to override the default newline behaviour of print. I have considered the following solutions

  • After writing the output simply do a .replace('\n', '\r\n'). This will interfere with HTTP messages that use multipart encoding.
  • Create a wrapper around the destination file object and proxy the .write method
  • def write(self, data):
        if data == '\n':
            data = '\r\n'
        return self._file.write(data)
    

  • Write a regular expression that translates print >>f, text to f.write(text + line_end) where line_end can be '\n' or '\r\n'.
  • I believe the third option would be the most appropriate. It would be interesting to hear what your Pythonic approach to the problem would be.

    like image 998
    brotchie Avatar asked Nov 04 '09 23:11

    brotchie


    2 Answers

    You should solve your problem now and for forever by defining a new output function. Were print a function, this would have been much easier.

    I suggest writing a new output function, mimicing as much of the modern print function signature as possible (because reusing a good interface is good), for example:

    def output(*items, end="\n", file=sys.stdout):
        pass
    

    Once you have replaced all prints in question, you no longer have this problem -- you can always change the behavior of your function instead! This is a big reason why print was made a function in Python 3 -- because in Python 2.x, "all" projects invariably go through the stage where all the print statements are no longer flexible, and there is no easy way out.

    like image 59
    u0b34a0f6ae Avatar answered Oct 09 '22 09:10

    u0b34a0f6ae


    (Not sure how/if this fits with the wrapper you intend to use, but in case...)

    In Python 2.6 (and many preceding versions), you can suppress the newline by adding a comma at the end of the print statement, as in:

    data = 'some msg\r\n'
    print data,  # note the comma
    

    The downside of using this approach however is that the print syntax and behavior is changed in Python3.

    like image 25
    mjv Avatar answered Oct 09 '22 08:10

    mjv