Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue when generating features from APT #329

Open
2909ft opened this issue Feb 13, 2020 · 23 comments
Open

Issue when generating features from APT #329

2909ft opened this issue Feb 13, 2020 · 23 comments

Comments

@2909ft
Copy link

2909ft commented Feb 13, 2020

Hello everybody!

I am trying to create a new JAABA project using the tracks from APT but I am running into some issues when generating features. (see screenshot) The file is present inside the experiment directory, I don't understand why JAABA cannot find it. Any ideas on how to solve this?

Also, I have another question: is it possible to create an experiment using only the tracks from APT? At the moment, I still track the video using motr, and then create an experiment based on that using PrepareJAABAData, and only then I transfer the trk file from APT to the experiment directory. Is there a more efficient way of doing this? Am I doing it completely wrong?

Kind regards,
Filipa
image

@mkabra
Copy link
Collaborator

mkabra commented Feb 13, 2020 via email

@2909ft
Copy link
Author

2909ft commented Feb 13, 2020

Dr. Mayank,

Thank you! Indeed, there was a sneaky dlc at the end of the file name, I completely missed it. It is wokrking fine now, and thanks for the tips for increasing efficiency.

Filipa

@2909ft
Copy link
Author

2909ft commented Feb 13, 2020

Also, another basic question related to APT: I cannot find the option to track all movies at once, only the current movie, the dropdown menu does not give me that option. Do I have to switch movies everytime I want to track a different one?

@allenleetc
Copy link
Collaborator

Hi Filipa,
Within the UI you are correct, you need to switch movies at the moment to track a new movie. The pulldown menu used to include options to track "all movies" but the menu got busy and hard to manage. How many movies do you need to track, and which tracker/backend are you using? If it is a large number of movies, we do have some "Production Tracking" facilities available for bulk tracking. Currently these are available at the command-line and not yet in the UI.
Allen

@2909ft
Copy link
Author

2909ft commented Feb 13, 2020

Dear Allen,

Currently I am just testing it, so only 5, but in the future I should have around 50 new videos every 2 weeks. How would I access these "production tracking" facilities?

Kind regards,
Filipa

@allenleetc
Copy link
Collaborator

Hi Filipa,

We will be documenting this soon and are also deliberating on some related updates. Do you need this immediately? If not please see kristinbranson/APT#263 where we will post updates. We should be getting to this fairly soon.

Thanks, Allen

@2909ft
Copy link
Author

2909ft commented Feb 17, 2020

Hey Allen! Thanks for the reply!

How soon? Beginning of March?

Thanks, Filipa

@arobie
Copy link
Collaborator

arobie commented Feb 17, 2020 via email

@2909ft
Copy link
Author

2909ft commented Feb 17, 2020

Dear Alice!

Thank you very much! The instructions are super clear!

Cheers,
Filipa

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

Hello! Sorry to bother again!

I tried running it, but I get the following errors:

Index exceeds the number of array elements (1).

Error in DLBackEndClass/getFreeGPUs (line 288)
freemem = freemem(1:nrequest);

Error in DeepTracker/getFreeGPUs (line 532)
[gpuid,freemem,gpuInfo] = be.getFreeGPUs(nrequest,varargin{:});

Error in DeepTracker/track (line 1949)
gpuids = obj.getFreeGPUs(nmovies*nviews);

Any idea on how to fix it? I trying to run this:

lObj.tracker.track({'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_2.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_3.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_5.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_6.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_11.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_14.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_17.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_18.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_34.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_67.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_73.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_75.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_77.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_80.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_85.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_87.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_92.avi';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_94.avi'},'trkfiles',{'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_2.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_3.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_5.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_6.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_11.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_14.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_17.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_18.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_34.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_67.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_73.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_75.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_77.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_80.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_85.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_87.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_92.trk';'Z:\Filipa\Bonsai_Chr2_Videos_Separated_Trials\m2sensoryD2_94.trk'})

@arobie
Copy link
Collaborator

arobie commented Feb 19, 2020 via email

@arobie
Copy link
Collaborator

arobie commented Feb 19, 2020 via email

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

Dear Alice,

I am using conda

Filipa

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

It passes the configuration test, if that helps

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

Also, another issue (this one more related to JAABA itself): I am trying to add new experiments to a jaaba classifier, but when I do so, JAABA tries to use the original trk file (the one I initally used when creating the classifier) to generate the new features on the perframe directory. However, the new experiments have different trk files, which means that JAABA is not be able to find the original trk, giving me an error message. Is there a way to get around this?

@arobie
Copy link
Collaborator

arobie commented Feb 19, 2020 via email

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020 via email

@allenleetc
Copy link
Collaborator

Hey Filipa,

I reproduced your issue with tracking. We can fix this but it will take a little time. I have noted it at kristinbranson/APT#263.

The production tracking stuff with the local backends (Conda/Docker) is newer and has not received as much testing. Alice had noted this as well we just hadn't gotten around to it.

If you are able to track for now in the UI, we can shoot to have the fix in March if that works. Let us know, thanks.

@arobie
Copy link
Collaborator

arobie commented Feb 19, 2020 via email

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

Dear Allen,

Yes, that would be great, thank you so much once again!

@2909ft
Copy link
Author

2909ft commented Feb 19, 2020

Dear Alice,

Ah, those are 2 great ideas!! Thanks a lot!

@allenleetc
Copy link
Collaborator

Hi Filipa,

Thanks for your patience with this. We fixed bulk tracking for local backends (Docker, Conda). The wiki https://github.com/kristinbranson/APT/wiki/Tracking-Movies-(DL-algorithms) has a few updates. If you have a single GPU in your workstation, APT will track your movies serially.

Can you please give this a try? If you encounter issues, please post under kristinbranson/APT#263 if possible.

Thanks,
Allen

@2909ft
Copy link
Author

2909ft commented Mar 20, 2020

Hi Allen!

Thank you very much for setting this up! I currently do not have access to a computer with a GPU since, due to the coronavirus situation, my workplace was closed without previous notice (I work in Italy). As soon as I do, I will test it :)

Thanks,
Filipa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants