Re: Octave 3.3.54 snapshot available for ftp

[John W. Eaton]

On 21-Nov-2010, Fredrik Lingvall wrote:

| I have problems building this one (and 3.3.53 too). It fails here:
| 
| <snip>
| 
| It's configured with:
| 
| ./configure  LDFLAGS="-lgfortran" F77=gfortran CFLAGS="-O3 -pipe
| -mtune=core2 -march=core2 -mfpmath=sse -msse2 -msse3 -mssse3 -msse4.1
| -msse4.2 \
| -fomit-frame-pointer -funroll-loops -fprefetch-loop-arrays -pthread"
| CXXFLAGS="-O3 -pipe -mtune=core2 -march=core2 \
| -mfpmath=sse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2
| -fomit-frame-pointer -funroll-loops -fprefetch-loop-arrays -pthread" \
| FFLAGS="-O3 -pipe -fdefault-integer-8 -mtune=core2 -march=core2
| -mfpmath=sse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 \
| -fomit-frame-pointer -funroll-loops -fprefetch-loop-arrays -pthread" \
| --enable-64 --prefix=/usr/local/ --with-blas=/usr/local/lib/libBLAS.so
| --with-lapack=/usr/local/lib/libLAPACK.so --enable-shared
| 
| on a Gentoo amd64 machine (core i7 MacBook Pro).

I checked in a couple of changes that should help when compiling with
--enable-64.  I'm also attaching a draft of the info you will need for
building a mostly functional version of Octave with this option.  Note
the advice about -fdefault-integer-8.  You need to set that in
F77_INTEGER_8_FLAG and not FFLAGS.  Otherwise, the files in
libcruft/ranlib will be miscompiled.  Although there is code in
configure.ac that attempts to move -fdefault-integer-8 from FFLAGS
to F77_INTEGER_8_FLAG, it does not seem to be working correctly for me
now.  Help debugging that problem would be welcome...

Help improving the attached document would also be welcome.  I suppose
it should go in the manual now, but I have not had time to convert it
to Texinfo.

Also, are you sure you need --enable-64?  Are you working with arrays
that contain more than 2^31 elements?  For double precision arrays,
that is 16GB.  How much memory does your MacBook have?  

jwe

Note: the following only applies to systems that have 64-bit
pointers.  Configuring Octave with --enable-64 cannot magically make
a 32-bit system have a 64-bit address space.

On 32-bit systems, Octave is limited to (approximately) the following
array sizes:

  double:    16GB
  single:     8GB 
  {u,}int64: 16GB
  {u,}int32:  8GB
  {u,}int16:  4GB
  {u,}int8:   2GB

In each case, the limit is really 2^31-1 elements because of the
default type of the value used for indexing arrays (signed 32-bit
integer, corresponding to the size of a Fortran INTEGER value).

Trying to create larger arrays will produce the following error:

  octave:1> a = zeros (1024*1024*1024*3, 1, 'int8');
  error: memory exhausted or requested size too large for range of Octave's 
index type -- trying to return to prompt

You will obtain this error even if your system has enough memory to
create this array (4 GB in the above case).

To use arrays larger than 2 GB, Octave has to be configured with the
option --enable-64.  This option is experimental and you are (as
always) encouraged to submit bug reports if you find a problem.  With
this option, Octave will use 64-bit integers internally for array
dimensions and indexing.  However, all numerical libraries used by
Octave will also need to use 64-bit integers for array dimensions and
indexing.  In most cases, this means they will need to be compiled
from source since most (all?) distributions which package these
libraries compile them with the default Fortran integer size.

The following instructions were tested with the development version of
Octave and GCC 4.3.4 on an x86_64 Debian system.

The versions listed below are the versions used for testing.  If newer
versions of these packages are available, you should try to use them,
though there may be some differences.
nnn
All libraries and header files will be installed in subdirectories of
$prefix64 (you must choose the location of this directory).


BLAS and LAPACK (http://www.netlib.org/lapack)

  Reference versions for both libraries are included in the reference
  LAPACK 3.2.1 distribution from netlib.org.

  Copy the file make.inc.example and name it make.inc.  The options
  -fdefault-integer-8 and -fPIC (on 64-bit CPU) have to be added to
  the variable OPTS and NOOPT.

  Once you have compiled this library make sure that you use it for
  compiling Suite Sparse and Octave.  In the following we assume that
  you installed the LAPACK library as $prefix64/lib/liblapack.a.


ARPACK (http://www.caam.rice.edu/software/ARPACK)

  In ARmake.inc set the following variables:

    home=path to directory ARPACK
    FC=gfortran 
    FFLAGS=-fPIC -fdefault-integer-8
    MAKE=/usr/bin/make 
    ARPACKLIB=$(home)/libarpack.a
    DIRS=$(UTILdir) $(SRCdir)

  Edit the file UTIL/second.f and change the line

    EXTERNAL           ETIME

  to

    INTRINSIC          ETIME

  After building .a library, you can make a shared version with

    mkdir tmp
    cd tmp
    ar x ../libarpack.a
    gcc -shared -o ../libarpack.so *.o -L$prefix64/lib -llapack -lblas 
    cd ..
    rm -rf tmp

  Copy the library libarpack.so to $prefix64/lib/libarpack.a.


QRUPDATE (http://sourceforge.net/projects/qrupdate)

  In the Makeconf file:

    Add -fdefault-integer-8 to FFLAGS.

    Adjust the BLAS and LAPACK variables as needed if your 64-bit aware
    BLAS and LAPACK libraries are in a non-standard location.

    Set PREFIX to the top-level directory of your install tree.

  Run make solib to make a shared library.

  Run make install to install the library.


SUITESPARSE (http://www.cise.ufl.edu/research/sparse/SuiteSparse)

  In UFconfig/UFconfig.mk use the following options for CFLAGS and F77FLAGS:

    CC = gcc
    CFLAGS = -fPIC -O -DLP64 -DLONGBLAS='long int' -DLONG='long int'
    F77 = gfortran
    F77FLAGS = -fPIC -O -fdefault-integer-8
    BLAS = -L$BLAS/lib -lblas -lgfortran"
    LAPACK = -L$LAPACK/lib -llapack"

  Disable the GPL-incompatible METIS library:

    CHOLMOD_CONFIG = -DNPARTITION
    SPQR_CONFIG = -DNPARTITION
    METIS_PATH =
    METIS =

  Disable the DI versions of the CHOLMOD library files by setting

    OBJ = $(DL)

  in CHOLMOD/Lib/Makefile.

  Disable the DI versions of the CHOLMOD tests by commenting out or
  deleting the following lines in CHOLMOD/Demo/Makefile:

    ./cholmod_demo < Matrix/bcsstk01.tri
    ./cholmod_demo < Matrix/lp_afiro.tri
    ./cholmod_demo < Matrix/can___24.mtx
    ./cholmod_demo < Matrix/c.tri
    ./cholmod_simple < Matrix/c.tri
    ./cholmod_simple < Matrix/can___24.mtx
    ./cholmod_simple < Matrix/bcsstk01.tri


  Run make to build the libraries.

  The SuiteSparse Makefile does not have an install target so you must
  install the files by hand:

    cp {AMD,BTF,CAMD,CCOLAMD,CHOLMOD,COLAMD,CXSparse,UMFPACK}/Lib/lib*a 
$prefix64/lib
    mkdir $prefix64/include/suitesparse
    cp {AMD,BTF,CAMD,CCOLAMD,CHOLMOD,COLAMD,CXSparse,UMFPACK}/Include/*h 
UFconfig/UFconfig.h $prefix64/include/suitesparse

  You can generate shared versions of these libraries by doing the
  following in the $prefix64/lib directory:

    top=$(pwd)
    for f in *.a; do
      mkdir tmp
      cd tmp
      ar vx ../$f
      gcc -shared -o ../${f%%.a}.so *.o
      cd $top
      rm -rf tmp
    done


QHULL
http://www.qhull.org

Suggestions on how to compile qhull will be most welcome.

Octave

Octave's 64-bit index support is activated with the configure option
--enable-64.

  ./configure \
    LD_LIBRARY_PATH="$prefix64/lib" \
    CPPFLAGS="-I$prefix64/include" LDFLAGS="-L$prefix64/lib" \
    --enable-64

You must ensure that all Fortran sources except those in the
libcruft/ranlib directory are compiled such that INTEGERS are 8-bytes
wide.  If you are using gfortan, the configure script should
automatically set the Makefile variable F77_INTEGER_8_FLAG to
-fdefault-integer-8.  If you are using another compiler, you must set
this variable yourself.  You should NOT set this flag in FFLAGS,
otherwise the files in libcruft/ranlib will be miscompiled.

Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License, Version 1.2 or
any later version published by the Free Software Foundation.

------------------------------------------------------------------------

Remaining Dependencies:

qhull
glpk

atlas instead of reference blas and lapack

Probably nothing special needs to be done for the following:

  pcre or regex
  zlib
  hdf5
  fftw3
  cURL
  GraphicsMagick++
  OpenGL
  freetype
  fontconfig
  fltk