Sikulix Beginner

I'm trying Sikulix on a dynabook N40 with Ubuntu Japanese Remix. Basically, everything that can be done on a PC since the mouse and keyboard are operable. Download jar file and just launch it.

$ java -jar sikulixide-2.0.5.jar

Then an editor will be launched. It is like an integrated development environment.

There is a button to take a screenshot, so you can cut out a part of the computer you want to operate. If you want to click with the mouse, just take the shot so that it is in the center of the image to be cut out. Since this is a trial, I'll start with google.com open in firefox. The screenshot part is easy to see in the image image when opened in the sikulix integrated environment, but when you save and look at the source (.py extension) later, it is automatically converted to the filenamed one.

#Left click on the Google search window. Center of image
click("1655010823490.png",10) 
#Search for "sikulix"
paste("sikulix") 
# Type ENTER key
type(Key.ENTER) 
# wait 10 seconds for search results
wait(10) 
# Capture search results
filename = capture(App.focusedWindow()) 
# display the filename where the captured result is stored
print(filename) 

When executed, the editor automatically disappears from the screen and starts up again when finished. The execution log is displayed on the right side of the editor, and the filename where the captured image specified by print is saved is also displayed there. It seems that the capture results appear under /tmp in Linux. This is so interesting for various applications.