Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Texture lookup in vertex shader behaves differently on iPad device vs iPad simulator - OpenGL ES 2.0

I have a vertex shader in which I do a texture lookup to determine gl_Position. I am using this as part of a GPU particle simulation system, where particle positions are stored in a texture.

It seems that: vec4 textureValue = texture2D(dataTexture, vec2(1.0, 1.0)); behaves differently on the simulator than the iPad device. On the simulator, the texture lookup succeeds (the value at that location is 0.5, 0.5) and my particle appears there. However, on the iPad itself the texture lookup is constantly returning 0.0, 0.0.

I have tried both textures of the format GL_FLOAT and GL_UNSIGNED_BYTE.

Has anyone else experienced this? The GLSL ES spec says that texture lookups can be done in both the vertex and fragment shaders, so I don't see what the problem is.

I am using the latest GM Beta of iOS SDK 4.2

like image 283
kcbanner Avatar asked Nov 15 '10 18:11

kcbanner


3 Answers

I just tested this as well. Using iOS 4.3, you can do a texture lookup on the vertex shader on both the device and the simulator. There is a bit of strangeness though (which is maybe why it's not "official" as szu mentioned). On the actual device (I tested on the iPad 2) you have to do a lookup on the fragment shader as well as on the vertex shader. That is, if you are not actually using it on the fragment shader, you'll still have to reference it in some way. Here's a trivial example where I'm passing in a texture and using the red pixel to reposition the y value of the vertex by a little bit:

/////fragment shader
uniform sampler2D tex; //necessary even though not actually used

void main() {
  vec4 notUsed = texture2D(tex, vec2(0.0,0.0)); //necessary even though not actually used
  gl_FragColor = vec4(1.0,1.0,1.0,1.0);
}

/////vertex shader
attribute vec4 position;
attribute vec2 texCoord;   
uniform sampler2D tex; 

void main() {
  float offset = texture2D(tex, texCoord).x;
  offset = (offset - 0.5) * 2.0; //map 0->1 to -1 to +1
  float posx = position.x;
  float posy = position.y + offset/8.0;

  gl_Position = vec4(posx, posy, 0.0, 1.0);  
}

I have a slightly fuller write-up of this at http://www.mat.ucsb.edu/a.forbes/blog/?p=453

like image 193
Angus Forbes Avatar answered Nov 13 '22 08:11

Angus Forbes


from the official "OpenGL ES Programming Guide for iOS", section "Platform Notes"

"You cannot use texture lookups in a vertex shader."

like image 6
szu Avatar answered Nov 13 '22 10:11

szu


This isn't the only thing that behaves differently in the sim versus the device. I'll make you the same suggestion I make everyone else: Ignore the simulator when you need to test that things look how they should on the device. Only test things like logic, functionality, not look on the sim, and only if you can.

like image 1
jer Avatar answered Nov 13 '22 10:11

jer