Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unstable rotor control #307

Closed
osrf-migration opened this issue Dec 30, 2019 · 17 comments
Closed

Unstable rotor control #307

osrf-migration opened this issue Dec 30, 2019 · 17 comments
Labels
bug Something isn't working critical

Comments

@osrf-migration
Copy link

Original report (archived issue) by Carlos Thomson (Bitbucket: Carlos Thomson).


Using the new velocity control interface for the rotors, they become unstable if there is disk usage in the computer (for example recording a ROS bag). This is easily reproducible, you just need to make the rotor hover and then run the command.

' stress -hdd 20'

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


  • set assignee_account_id to "557058:90bc87b0-2886-4377-a17c-3a6629a697ff"
  • set assignee to "azeey (Bitbucket: azeey, GitHub: azeey)"

@osrf-migration
Copy link
Author

Original comment by Addisu Z. Taddese (Bitbucket: azeey, GitHub: azeey).


I'm able to reproduce this issue and I am investigating why it's happening.

@osrf-migration
Copy link
Author

Original comment by Carlos Thomson (Bitbucket: Carlos Thomson).


Any progress on this issue? When accessing the different levels in the map, it seems that there is also disk access and it makes the robot crash.

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


Carlos,

Can you attach or post here the content of your /proc/cpuinfo file and also the output from the command below?

nvidia-smi

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


Let me know also if you are using a local catkin workspace for your testing.

@osrf-migration
Copy link
Author

Original comment by Carlos Thomson (Bitbucket: Carlos Thomson).


+-----------------------------------------------------------------------------+
| NVIDIA-SMI 430.26 Driver Version: 430.26 CUDA Version: 10.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce RTX 2060 Off | a527ae8:01:00.0 On | N/A |
| 0% 43C P8 9W / 170W | 585MiB / 5931MiB | 1% Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1652 G /usr/lib/xorg/Xorg 24MiB |
| 0 1716 G /usr/bin/gnome-shell 51MiB |
| 0 2708 G /usr/lib/xorg/Xorg 266MiB |
| 0 2840 G /usr/bin/gnome-shell 171MiB |
| 0 25407 G ...uest-channel-token=10129901168743816945 68MiB |
+-----------------------------------------------------------------------------+

Alfredo Bencomo (bencomo) and yes, we are using a catkin workspace.

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


Did you also attach the /proc/cpuinfo file?

@osrf-migration
Copy link
Author

Original comment by Carlos Thomson (Bitbucket: Carlos Thomson).


processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 158
model name : Intel(R) Core(TM) i7-9850H CPU @ 2.60GHz
stepping : 13
microcode : 0xca
cpu MHz : 800.081
cache size : 12288 KB
physical id : 0
siblings : 12
core id : 0
cpu cores : 6
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 22
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d arch_capabilities
bugs : spectre_v1 spectre_v2 spec_store_bypass swapgs
bogomips : 5199.98
clflush size : 64
cache_alignment : 64
address sizes : 39 bits physical, 48 bits virtual
power management:

@osrf-migration
Copy link
Author

Original comment by Addisu Z. Taddese (Bitbucket: azeey, GitHub: azeey).


https://bitbucket.org/ignitionrobotics/ign-gazebo/pull-requests/498 should address the problem. Can you give it a try?

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


Carlos Thomson (Carlos Thomson) with regard, When accessing the different levels in the map, it seems that there is also disk access and it makes the robot crash. We are not able to reproduce it, but if you can, then would you mind recording a screencast showing the moment and section of the world when it occurs? Thanks!

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


Carlos Thomson (Carlos Thomson) in the event that you can reproduce it with your Docker solution, then you can also just upload it into Cloudsim and run it there. We will then review it locally.

@osrf-migration
Copy link
Author

Original comment by Arthur Schang (Bitbucket: Arthur Schang).


Carlos Thomson (Carlos Thomson) the fix is available for catkin workspace configurations.

sudo apt update && sudo apt upgrade -y then run your experiment again. If you're still encountering issues, update your subt workspace, clean, and rebuild then try again. This fix worked for me.

@osrf-migration
Copy link
Author

Original comment by Angela Maio (Bitbucket: Angela Maio).


Carlos Thomson (Carlos Thomson) are you still having this issue?

If anyone else sees this issue when running with either catkin or docker, please Vote for this issue in the status block

@osrf-migration
Copy link
Author

Original comment by Carlos Thomson (Bitbucket: Carlos Thomson).


Sorry for the late response, we have been very busy these last two weeks, tomorrow we will do a complete test of the fix and report the results back.

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


This should now work as expected. Update your system or pull the latest Docker image(s). Reopen if you still encounter problems.

@osrf-migration
Copy link
Author

Original comment by Carlos Thomson (Bitbucket: Carlos Thomson).


Alfredo Bencomo (bencomo) Arthur Schang (Arthur Schang) We have tested the fix and indeed it works as expected now, thank you for the fix.

@osrf-migration
Copy link
Author

Original comment by Alfredo Bencomo (Bitbucket: bencomo).


  • changed state from "resolved" to "closed"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working critical
Projects
None yet
Development

No branches or pull requests

1 participant