Re: testing framework GSOC

[Werner LEMBERG]

Hello Aman,


> i wanna ask that can we run this framework in any other way than
> running locally or not?

The idea is to have this run remotely eventually, using the CI
capabilities of the gitlab instance on freedesktop.org (or maybe
something else in case this isn't sufficient for whatever reason) to
automatically generate HTML pages with images.

However, it doesn't make a big difference: The CI stuff has to be
tested and prepared locally; to do debugging is probably a nightmare
otherwise.

So it boils down whether it is ok that extra prerequisites are
required, and the answer is yes.

Here is an example MR (merge request) for the LilyPond typesetter that
I've already sent some months ago to the list:

  https://gitlab.com/lilypond/lilypond/-/merge_requests/589

and here are the artifacts of a successfully executed pipeline job for
online viewing (doing `make test` for the MR and comparing it to a
baseline's `make test`):

  
https://lilypond.gitlab.io/-/lilypond/-/jobs/944871436/artifacts/test-results/index.html

Whether you say `make test` on your computer or whether the CI engine
does `make test`, there isn't a difference.  In both cases HTML files
are generated.

> Please do share the process because i got nothing related to this
> related on readme..  and is process of running locally is written
> clearly in the documentation because there is difference between
> instructions given in readme and report given to mailing list by
> Greg Williamson.

It is not clear what problems arise for you because of the local
vs. remote thing.  Please elaborate.  Maybe I don't understand you
correctly.


    Werner