I am making accessability/vision software. I want to take a Java
applet (made by other company on their website so obviously can not be
changed by me) and feed/automate a click at a particular spot/pixel.

Next, I would like to be able to read text from one of the java
controls BUT would settle for just reading the entire applet's window
as a bitmap if I absolutely had to (and then trying to disect the
bitmap to  get at the text).

I'm looking for how to do this as quickly as possible. Whatever you
can find would be great. C++ examples, free C++ libraries that make it
easy, etc. The KEY thing is that the java can not be changed because
it isn't mine and is loaded from other servers.

---

Clarification of Question by casmallbusinessowner-ga on 19 Jul 2006 11:30 PDT

I don't need a full code, links to examples and free C++ libraries
that do it, is good enough.

I know how to do these things, but I have to make sure we're talking
about the same thing here before I give you the code for it (and
explain what it all does).

"feed/automate a click at a particular spot/pixel."

I know how to automate clicking if you're using Microsoft Windows, but
the applet has to be the active window. I think I can also provide
help if you don't want it to be an active window, but I'll need you to
clarify that first.

"Next, I would like to be able to read text from one of the java
controls BUT would settle for just reading the entire applet's window
as a bitmap if I absolutely had to (and then trying to disect the
bitmap to get at the text)."

You're getting into some more complicated stuff with this, because you
need an OCR (Optical Character Recognition) algorithm. That shouldn't
be too difficult, but, again, I need clarification on what kind of
text and in what context it appears. Certain OCR algorithms are good
for certain things, and there isn't one univeral one that can be made
for every case. So, I'll need information on what you're trying to
read in, first.