NEWS

fastText 1.0.8 (2026-05-12)

I fixed a bug in the 'language_identification()' function where input text that could be interpreted as a directory path (e.g. "../.." or "data" when a data/ folder exists) caused an error. The fix replaces file.exists() with utils::file_test(op = "-f", ...) to correctly distinguish regular files from directories (see Github issues: https://github.com/mlampros/fastText/issues/6 and https://github.com/mlampros/fastText/issues/3)

I fixed the CRAN warning: explicit by-copy capture of this with by-copy capture default only available with -std=c++20 or -std=gnu++20 [-Wc++20-extensions] in the /src/fasttext.cc file

I fixed the CRAN warning: implicit capture of 'this' via '[=]' is deprecated in C++20 [-Wdeprecated]

I fixed a DESCRIPTION field omission related to a paper 'doi' weblink and removed the SystemRequirements section
I removed the "CXX_STD = CXX11" from the "Makevars" files, and the "[[Rcpp::plugins(cpp11)]]" from the .cpp files due to the following Warning from CRAN, "SystemRequirements specified C++11: support has been removed" (see also: https://www.tidyverse.org/blog/2023/03/cran-checks-compiled-code/#note-regarding-systemrequirements-c11)

I added a figure to the README.md file showing the differences between static and contextualised word embeddings

I added a test case for the 'language_identification()' function (see Github issue: https://github.com/mlampros/fastText/issues/3)
I added the 'verbose' parameter to the C++ functions of the 'src/main.cc' file that did not take any variables as input to avoid the CRAN WARNING 'function declaration isn't a prototype [-Wstrict-prototypes]'

I added the URL and BugReports fields in the DESCRIPTION file
I updated the documentation of the print_parameters() function
I updated the details section of the fasttext_interface() function regarding the output parameter which exists in the named list that is passed to the list_params parameter of the fasttext_interface() function. Although this output parameter is a file path (and not a directory name) it will be saved in both .vec and .bin file name extensions.

I fixed the LTO (Link Optimization Error) - Additional Issues - by replacing the qnorm variable with qnorm_param in the Rcpp files
I modified the quantize function in the Rcpp file to return the .ftz file by specifying the exact file path
I adjusted the Examples section of the fasttext_interface function and the testthat tests to account for the changes in the quantize function
I fixed a bug of the fasttext_interface function related to parameters that do not take a value

I've added the CITATION file in the 'inst' directory
I've added the language_identification() function
20-04-2021 : I've added the pre-trained language identification model lid.176.ftz which can be downloaded from https://fasttext.cc/docs/en/language-identification.html In the same website exists also the lid.176.bin model which is bigger in size, faster and slightly more accurate.
14-07-2019 : I fixed typos in vignette and modified the plot_progress_logs() function because it threw an error of the form : line 1 did not have 11 elements ( I added the fill = TRUE parameter to the utils::read.table() function to account for NA's as described in a stackoverflow issue )