Microsoft UI Automation Framework是否可以与Chrome，Python和Java Apps一起使用? [英] Does Microsoft UI Automation Framework work with Chrome, Python and Java Apps?

问题描述

我正在从事一个自动化项目，我需要在其中捕获用户在桌面上执行的活动[启动的应用程序，输入的数据，输入类型等].我遇到了Microsoft UI Automation框架，到目前为止，该框架对基于本机Windows的应用程序(如MS Office，.NET应用程序等)都非常有效.但是，我没有找到任何有用的信息/从不同的Web浏览器捕获信息的示例. ，Python应用程序，Java应用程序等.有人可以确认MS UI自动化框架是否支持此类应用程序.从这些应用程序中提取用户活动的任何可行示例都将受到高度赞赏.谢谢.

I am working on an automation project, in which I need to capture the activities [ application launched, data entered, input type etc.] user performs on a desktop. I came across Microsoft UI Automation framework which so far works well for native windows based applications like MS Office, .NET apps etc. However I did not find any useful information / samples of capturing the information from different web browsers [Chrome is a must], Python apps, Java Apps etc. Can someone please confirm whether MS UI Automation Framework supports such apps. Any working example to extract user activities from these apps would be highly appreciated. Thanks.

推荐答案

Simon答案的一些补充...

Some additions to Simon's answer...

Chrome页面内容.仅适用于现有的Chrome程序，它将无法使用.尽管用户可以手动创建一个新的选项卡chrome://accessibility并为所有或某些选定的页面启用UIA.此方法也适用于Linux上的AT-SPI可访问性技术.当然，Selenium WebDriver在这里是行业标准.但是存在另一种方式.默认情况下，Mozilla和IE都支持UIA.

Chrome page content can be seen by UIA if you run chrome --force-renderer-accessibility. Only for existing Chrome process it won't work. Though user can create a new tab chrome://accessibility manually and enable UIA for all or some chosen pages. This method also works for AT-SPI accessibility technology on Linux. Of course, Selenium WebDriver is an industry standard here. But another way exists. Both Mozilla and IE support UIA by default.

Inspect.exe可以简单地从此GitHub存储库下载.

关于Java应用程序，这取决于应用程序类型.您的机会约为50/50.

Regarding Java apps it depends on the app type. Your chances is about 50/50.

WxPython或PyQt5对UIA有好处. TkInter或Kivy应用程序不是.

WxPython or PyQt5 are good for UIA. TkInter or Kivy apps are not.

P.S.有一个示例如何拖动文件使用Python库 pywinauto 从explorer.exe拖放到Chrome中的Google Drive .

P.S. There is an example how to drag a file from explorer.exe and drop to Google Drive in Chrome using Python library pywinauto.

这篇关于Microsoft UI Automation Framework是否可以与Chrome，Python和Java Apps一起使用?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！