Pan & Tilt Face Tracking in ROS

Pan & Tilt Face Tracking in ROS

About

Do you want to do a face tracking Pan & Tilt system with ROS? This is the tutorial for you! This video will show you how to do a face tracking system using ROS and all the system we generated in the previous videos.

We will learn:

  • How to integrate icog_face_tracker package in ROS
  • How to use face tracking data to do a simple face tracker for a Pan &  Tilt

List of materials

Related courses & tutorials

3D Models

[irp posts=”13228″ name=”Pan & Tilt Gazebo Simulation”]

Pan & Tilt Gazebo Simulation

Pan & Tilt Gazebo Simulation

About

In this video you will learn:

  • How to create a Pan & Tilt Gazebo simulation
  • How to connect it to previous real robot server

List of materials

Related courses & tutorials

3D Models

#PanAndTilt #Pan&Tilt #Simulation #Gazebo #Robot #rostutorials #Ubuntu

[irp posts=”13154″ name=”Create ROS Server to Access Pan & Tilt”]

Create ROS Server to Access Pan & Tilt

Create ROS Server to Access Pan & Tilt

About

Learn how to create a ROS node server and some custom messages to access the real Pan & Tilt. This way any ROS program will be able to access the Pan & Tilt and will serve as the base for creating a simulation in the next video.

Git of Pan And Tilt Project

List of materials

Related courses & tutorials

3D Models

[Morpheus Chair] Pan & Tilt with Raspberry Pi and ROS | S3.Ep.1

[Morpheus Chair] Pan & Tilt with Raspberry Pi and ROS | S3.Ep.1

About

In this video, you are going to learn how to set up your raspberry pi to use the Pan & Tilt Hat created by WaveShare.
We will create a python class to move the two servos and test all its functionality.

Remember to leave a message of love to ANKI 😉 with the Hashtag #WeLoveYouANKI

List of materials

Related courses & tutorials

3D Models

[Morpheus Chair] Vector ROSDS CloudConnection | T2.Ep.4

[Morpheus Chair] Vector ROSDS CloudConnection | T2.Ep.4

About:
In this video, you are going to learn how to connect to the real Vector ROBOT through ROSDS using the real robot connection tools. You will also use a docker created by betaB0t to connect to VECTOR.

Commands to launch the docker in your local PC:

sudo docker run -e ANKI_USER_EMAIL=(EMAIL) -e ANKI_USER_PASSWORD=(PASSWORD) -e VECTOR_IP=(VECTOR_IP) -e VECTOR_SERIAL=(VECTOR_SERIAL) -e VECTOR_NAME=(VECTOR_NAME) –network host -e ROS_IPV6=on -e ROS_HOSTNAME=(NAME_OF_YOUR_DEVICE) -e ROS_MASTER_URI=http://master:11311 –add-host master:::1 –add-host (NAME_OF_YOUR_DEVICE):::1 -it betab0t/vector-ros-driver

If you don’t know the VECTRO related values, please have a look at the first video where we connected directly to VECTOR:

———————————————————————–
ROSject with Simulation and code Plug and Play:
http://www.rosject.io/l/908ce19/

Git from BetaB0t for Vector_ROS Package:

Git for the Real Robot Connection Setup:
https://bitbucket.org/theconstructcore/rosds_real_robot_connection/src/master/

Git of Vector and Cozmo Simulation:
https://bitbucket.org/theconstructcore/cozmo_simulation/src/master/

Install SDK in ALL OS:
https://developer.anki.com/vector/docs/initial.html

VECTOR API:
https://developer.anki.com/vector/docs/api.html

———————————————————————–

Here you can find the list of materials that you will need for this session:
Vector Robot: https://www.amazon.es/Anki-000-0079-Vector/dp/B078T42JCM
Vector Robot Playing Space ( recommended to avoid any problems with flying Vectors :P): https://www.amazon.es/Anki-000-0078-Habitat-Vector-Space/dp/B07G3QSX8G

———————————————————————————
Music:
Original Track:https://youtu.be/FBv6rm1lY0w
Thanks to NewRetroWave for letting us use their music.
Here more info:

New Retro Wave + Bachelor of Hearts Aurora Borealis

Smooth vibes for you retro soul. Listen and enjoy.
OUT NOW on NRW Records:
https://newretrowave.bandcamp.com/album/a-cosmic-funk-odyssey-ep
iTunes: http://apple.co/2r6N1T7

Support:

https://www.facebook.com/BachelorOfHeartsmusic/

Artwork provided by Murryous, who is our featured artist for May. Please support him:
https://www.instagram.com/murryous/

———————————————————————————

3D Models:
Orange Robot:
https://www.blendswap.com/blends/view/77718

Sphere Robot:
https://www.blendswap.com/blends/view/80818

Robot Parts:
https://www.blendswap.com/blends/view/78357

Mars Lander:
https://www.blendswap.com/blends/view/81264

#VECTOR #COZMO #ANKI #ROS #Robot #rostutorials #simulation to real

[Morpheus Chair] Vector ROS Simulation | T2.Ep.3

[Morpheus Chair] Vector ROS Simulation | T2.Ep.3

.

What will you learn in this post

  • Learn how to launch the Vector simulation and how to launch a Red Ball tracking node using ROS and the
    package created by BetaB0t Vector_ROS

List of resources used in this post

More resources (for real robot)

 

Launching COZMO and VECTOR simulations

If you click in the ROSject provided above (http://www.rosject.io/l/908ce19/), you will get a copy of it on ROSDS (ROS Development Studio)

To launch it, you first need to open the ROSject clicking on the Open button.

Open Cozmo and Vector robots in ROSDS

Open Cozmo and Vector robots in ROSDS

Once the ROSject open, you just launch the simulation by clicking  Simulations–>Select Launch File, then you select  cozmo_gazebo main_cozmo.launch

Launch cozmo_gazebo main_vector.launch in ROSDS

Launch cozmo_gazebo main_vector.launch in ROSDS

If everything went ok, now you should have the simulation up and running:

cozmo vector running in ROSDS

cozmo vector running in ROSDS

You can launch cozmo and vector just by choosing between the main_vector.launch and main_cozmo.launch

You can access the camera, the forklift, the wheels (through the /cmd_vel ROS Topic), imu and the Infra-Red sensors form their corresponding topics. All the topics have the exact same name in the two different robots, except that you have to change the word vector for cozmo.

Launching the Simple Red Ball tracking

To do so you have to launch the simulation you want, in this case, we will launch the Vector simulation as described in the previous section.

Launch cozmo_gazebo main_vector.launch in ROSDS

Then open a Webshell from the Tools Bar (Tools -> Shell), and execute the following commands:

roslaunch vector_ros simple_ball_tracker.launch is_simulation:=true

You should then Open the Graphical Tools from the Tools menu to see the RedBall detection Gui:

Launching Graphical Tools in ROSDS

Launching Graphical Tools in ROSDS

You should then be able to see the robot camera:

redball seen by cozmo and vector in ROSDS

redball seen by cozmo and vector in ROSDS

If you now move the ball around with the move object icon of the 3D view, you can see how Vector follows the ball. You can also move the ball with the keyboard, which will send absolute position commands to the ball. You first need to run the launch file below:

roslaunch cozmo_gazebo move_redball.launch

Then use the Keys below:

i“=+X Axis,

k“=STOP,

j“=-Y Axis,

l“=+Y Axis,

,“=-X Axis:

 

Moving the robot around

With the ball tracking enabled, you can move the robot around using the command below in the web shell:

rosrun teleop_twist_keyboard teleop_twist_keyboard.py
Reccomended values:
    turn = 5.55991731349
    speed = 0.1937102445

Seeing the camera

In order to see the camera in the Graphical Tools, you can run rqt_image_view through the webshell using the command below:

rosrun rqt_image_view rqt_image_view

Now open the Graphical Interface as explained earlier by clicking Tools -> Graphical Tools.

Moving FORK and Head

Before publishing the positions of the fork, it is worth mentioning that the fork range is [0.0,-0.8]

Now, let’s go ahead and move it with the command below:

rostopic pub /vector/lift_height/command std_msgs/Floa4 "data: -0.8"

Now, to move the head we use the commands below. Also, important to note that the range of the head is [0.1,-0.57]

Let’s then move the head:

rostopic pub /vector/head_angle/command std_msgs/Float64 "data: -0.57"

 

Where is the IMU

To see the IMU of the robot, you can see the /imu topic using the command below:
rostopic echo /imu

Current known issues

We noticed that there is a drift that occurs when Vector or Cozmo is still.

SPECIAL THANKS:

Our special thanks to beat_b0t for creating the Vector_ROS package.

Also, thanks to TheConstructSim For creating the COZMO and Vector simulation package. and thanks to ANKI for creating COZMO and VECTOR real robots that we can use to play around and learn more about robotics.

Youtube Video

We hope you like the post. If you prefer, we also have a live version of this post in YouTube. You can find it in the link below. If you like it, please consider subscribing to our channel on youTube. We are constantly adding new ROS-related content.

 

———————————————————————————
Music:
Original Track:https://youtu.be/FBv6rm1lY0w
Thanks to NewRetroWave for letting us use their music.
Here more info:

New Retro Wave + Bachelor of Hearts Aurora Borealis

Smooth vibes for you retro soul. Listen and enjoy.
OUT NOW on NRW Records:
https://newretrowave.bandcamp.com/album/a-cosmic-funk-odyssey-ep
iTunes: http://apple.co/2r6N1T7

Support:

https://www.facebook.com/BachelorOfHeartsmusic/

Artwork provided by Murryous, who is our featured artist for May. Please support him:
https://www.instagram.com/murryous/

———————————————————————————

3D Models:
Orange Robot:
https://www.blendswap.com/blends/view/77718

Sphere Robot:
https://www.blendswap.com/blends/view/80818

Robot Parts:
https://www.blendswap.com/blends/view/78357

Mars Lander:
https://www.blendswap.com/blends/view/81264

#Vector #COZMO #ANKI #ROS

Pin It on Pinterest