Closed

alogorithm

Goal: Use the agent to explore the Android UI to reach as many new UI states as possible. By exploring the states, agent hopes to find possible combinations of events/inputs that lead to unintended behavior like app crashes.

I have integration Droidbot ([login to view URL]) with two agents: Actor Critic and DQN. Since I made it a gym environment, you can use any type of algorithm from any RL package that works with gym.

I modified Droidbot to work as a gym environment. This allows you to integrate Droidbot with any major Reinforcement Learning library that works with gym environments (which is all of the major ones). I then intergrated the Droidbot gym environment with the Stable Baselines Reinforcement Learning library. I trained multiple agents and provided a script for running the Actor-Critic agent in the code's README file. This will generate an agent that learns to explore the android app UI and the agent will train a policy for the interaction. I also included a Deep Q Network agent and instructions for how to run that agent.

I added an option to add unexplored events to the action space in the env so the agent can prioritize them.

Going forward here are the issues and improvements that can be done:

Modify the agent to prioritize taking unexplored events. Those unexplored events would then be added to the DQN agent's replay buffer. Only when the agent is choosing between explored events does the agent's selection process kick in.

Explore parellelization for greater speed. Android emulators run a bit slow. Droidbot can be parallelized and RL libraries usually can though it's unclear the best way to do so.

Train agents with various hyperparameters to find the ideal agent parameter settings.

Decide on a better observation/state space representation. I created an observation space for the past four frames using image data. The papers you sent me all have different and interesting ways of doing the observation space representation before inputting it into the model. These are all quite involved and many possible choices can be made. I like the way Humanoid describes it and some code may be available from the github repo to make the transition easier.

Decide on a better action space. This env is complicated because the number of actions at each step is different. I made the env so that the number can be regenerated at each step or fixed at the beginning. I defaulted it to a fixed number since RL libraries typically prefer it this way. You can do a variable number of actions but that typically involves inputting a state representation and an action representation into the model for each action, scoring them, and then taking the best one. However since there is no action representation, I couldn't model it that way. Humanoid has a good option for modelling action representations in either a fixed action space or a variable action space and some of the code may be available from that github repo. The other research papers you had have some other alternatives.

Skills: Android, Mobile App Development, Machine Learning (ML), Artificial Intelligence

See more: so_rcvbuf speed, speed local positioning system, php script speed test, php processing speed test, php script connection speed tester, download speed test script, find percentage goal, goal meter website html, speed phpbb3, variable speed voice playback, sockscap bit, creloaded speed database, business goal funny pic, speed track consultant, warrock anti kick speed fast ammo hack, anti kick super jump speed premium hack warrock download, little bit slower normal speed, Hamra net nhi Chao RHA speed but slow h

About the Employer:
( 0 reviews ) Kenya

Project ID: #20407556

9 freelancers are bidding on average $506 for this job

technorizen

Hello, I have 6 years of experienced on mobile application ( Android +iphone/ ipad ) and App admimn with development web services where admin can manage the app from backend ,. I have developed the Transport App , R More

$500 USD in 7 days
(186 Reviews)
8.6
shreeyait

Hello Sir, How are you? you are doing well!!! I am Pratik, a Business Development Manager at Shreeyait Solutions ([login to view URL]) and we are giving best Mobile app services since 2013 and have ver More

$500 USD in 10 days
(40 Reviews)
6.9
appmasteramlesh

Hello, I have gone throw details of your project , i am highly experience developer and working with a small team as i have designer and developer for android ,ios and backed... as i have understood you need android More

$250 USD in 11 days
(11 Reviews)
5.4
ownmyserver

Hello Greetings...!! I have read your project requirements. I am familiar with all required technologies and I have experienced resource to start with your project. Either we can go with fix cost or you can hire us o More

$500 USD in 7 days
(14 Reviews)
5.0
supersuntech

First:- Chatbot --> This can be integrated by any Facebook page, Slack etc. Its main aim is to reduce the human effort. For example, if this Chatbot is integrated with company page so it can easily answer you some bas More

$500 USD in 7 days
(7 Reviews)
4.8
$555 USD in 10 days
(1 Review)
3.7
shingjin

Dear Client. First of all, it's my pleasure to bid on your project. I am very interested in your proposal. Because I have rich experience in this field. If you choose me, you'll never be disappointed in me, and I'll do More

$500 USD in 7 days
(4 Reviews)
2.8
sky930320

Dear Sir. Glad to meet you. I'm very interested in your job post involving these skills. I'll bring your idea to the next level or extend your live project with new awesome features. I'm web Developer specializing in More

$500 USD in 7 days
(1 Review)
2.8
caesius

Hi, I AM THE BEST CHOICE HERE. I am writing my thesis for my phd which is about RL and IRL, and all about the algorithms related. I am using gym and creating gym environments as well. I am a MuJoCo expert as well. I am More

$750 USD in 7 days
(0 Reviews)
0.0