Automation tool similar to Sikuli

Question

I really like the feature in Sikuli that allows you to select a screenshot to click and specify where within that screenshot to click. For example when there are multiple buttons that look the same, just taking a screenshot of the button itself won't cut it because Sikuli can't differentiate.

Some other automation tools don't allow you to select where you want the mouse to click within a screenshot, or it is difficult to specify where you want the mouse to click.

So my question is, is there another software tool that has this feature that Sikuli has? The reason I'm looking for something else is because I don't want to rely on image recognition completely. I was hoping to use pywinauto with Sikuli to do some of the automation, but that isn't possible.

Answer 1

We are using now gehrmann/PyGUIBot (python and free): https://pyguibot.wordpress.com/

Has a command line interface and GUI, records screencasts, with simple graphical programming language. Good for GUI-unittests or user interaction scripting.

Never used it on Windows, only on Ubuntu or Debian, but it looks like a cross-platform tool.

Answer 2

There is at least one: eggPlant by TestPlant.

It is an automation tool using image recognition, and

You can search part of the screen by setting the SearchRectangle global property.

References:
http://www.testplant.com
http://docs.testplant.com/ePF/using/epf-finding-images.htm#Working

---

For Python integration Automa would be nice, and it does have nifty image recognition functions where you can have multiple image parts working together. Not exactly what you are asking but it just might be of use.

References:
http://www.getautoma.com
http://www.getautoma.com/features/image_recognition

---

The odds are a bit longer but possibly AutoIt can help you as well. It interfaces with the standard Windows GUI objects and has the benefits of being both very stable and quite easy to use. It has a small tool you can use to show the properties of the screen object you want to access. No learning curve to speak of, however no image recognition or real integration to Python either.

Reference:
https://www.autoitscript.com/site/autoit/